-- Logs begin at Mon 2022-07-25 05:02:56 UTC, end at Mon 2022-07-25 06:30:23 UTC. -- Jul 25 05:49:21.777399 dv-cinder-848418-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 05:49:21.787908 dv-cinder-848418-2-smb devstack@keystone.service[80325]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 05:49:21 2022] *** Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: nodename: dv-cinder-848418-2-smb Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: machine: x86_64 Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: clock source: unix Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: pcre jit disabled Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: detected number of CPU cores: 4 Jul 25 05:49:21.789968 dv-cinder-848418-2-smb devstack@keystone.service[80325]: current working directory: / Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: detected binary path: /usr/bin/uwsgi-core Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: your processes number limit is 47680 Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: your memory page size is 4096 bytes Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: detected max file descriptor number: 2048 Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: lock engine: pthread robust mutexes Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: thunder lock: enabled Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 05:49:21.790553 dv-cinder-848418-2-smb devstack@keystone.service[80325]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 05:49:21.834959 dv-cinder-848418-2-smb devstack@keystone.service[80325]: Python main interpreter initialized at 0x558e5cc829c0 Jul 25 05:49:21.834959 dv-cinder-848418-2-smb devstack@keystone.service[80325]: python threads support enabled Jul 25 05:49:21.834959 dv-cinder-848418-2-smb devstack@keystone.service[80325]: your server socket listen backlog is limited to 100 connections Jul 25 05:49:21.834959 dv-cinder-848418-2-smb devstack@keystone.service[80325]: your mercy for graceful operations on workers is 90 seconds Jul 25 05:49:21.835410 dv-cinder-848418-2-smb devstack@keystone.service[80325]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 05:49:21.835538 dv-cinder-848418-2-smb devstack@keystone.service[80325]: *** Operational MODE: preforking *** Jul 25 05:49:21.835805 dv-cinder-848418-2-smb devstack@keystone.service[80325]: *** uWSGI is running in multiple interpreter mode *** Jul 25 05:49:21.835805 dv-cinder-848418-2-smb devstack@keystone.service[80325]: spawned uWSGI master process (pid: 80325) Jul 25 05:49:21.836012 dv-cinder-848418-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 25 05:49:21.836590 dv-cinder-848418-2-smb devstack@keystone.service[80325]: spawned uWSGI worker 1 (pid: 80337, cores: 1) Jul 25 05:49:21.837363 dv-cinder-848418-2-smb devstack@keystone.service[80325]: spawned uWSGI worker 2 (pid: 80338, cores: 1) Jul 25 05:49:21.837363 dv-cinder-848418-2-smb devstack@keystone.service[80325]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 05:49:27.338767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:27.338767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: from cryptography.utils import int_from_bytes Jul 25 05:49:27.339542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:27.339542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: from cryptography.utils import int_from_bytes Jul 25 05:49:27.349509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:27.349509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: from cryptography.utils import int_from_bytes Jul 25 05:49:27.349974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 05:49:27.349974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: from cryptography.utils import int_from_bytes Jul 25 05:49:27.388184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:49:27.388376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:49:27.388571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] command line args: [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:49:27.388840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:49:27.389020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ================================================================================ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:49:27.389275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] admin_token = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.389519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_dir = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.389709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.389892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_source = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.390089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] debug = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.390318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.391887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_config_append = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.392058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.392246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_dir = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.392436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.392693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.392951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.393216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.393463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.393641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.393817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.394061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.394315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.394548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.394790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.395043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.395287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.395577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.395827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.396119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.396632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.396829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] publish_errors = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.397078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.397400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.398196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.398596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.398675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 05:49:27.398842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 05:49:27.398919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.399065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] command line args: [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 05:49:27.399150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] standard_threads = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.399342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.399417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 05:49:27.399542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ================================================================================ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 05:49:27.399640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.399819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.399906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] admin_token = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_journal = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_dir = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_json = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_stderr = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] config_source = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_syslog = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] debug = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.400963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.401102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.401182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.401301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.401430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.401563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.401704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.401827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.402094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_config_append = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.402467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.402653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_dir = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.402886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.403060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.403145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.403318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.403416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.403597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.403717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.403863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.403985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.404070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.404241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.404325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.404489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.404574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.404729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.404813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.404956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.405033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.405183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.405262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.405410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.405495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.405637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.405786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.405943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.406018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.406088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.406259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.406358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.406508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.406784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.406862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.407005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] publish_errors = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.407087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.407242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.407333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.407456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.407570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.407662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.407811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.407897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.408056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.408140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.408309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.408392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] standard_threads = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.408533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.408618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.408770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.408854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.408933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.409060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.409137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_journal = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.409267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_json = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.409352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.409430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_stderr = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.409540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.409617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] use_syslog = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.409805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.409884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 05:49:27.410053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.410864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.411987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.412966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.413970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.414935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.415997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.416918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.417856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.418971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.419990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.420914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.421969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.422983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.423964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.424840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.425946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.external = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.426991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.427949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.password = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.token = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.428848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.429954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.430995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.431976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.432901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.433977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.434937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.external = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.435997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.password = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] auth.token = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.436944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.437918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.438985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.439888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.440954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.441922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.442867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.443990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.444069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.444757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.444861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.445958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.446993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.447969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.448939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.449856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.450838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.451956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.452977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.453924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.454861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.455977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.456996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.457938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458638 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.458874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.459945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.460708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.460834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.460964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.461990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.462960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.463939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.464881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.465999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.466956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.467911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.468920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.469951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.470975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.471917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.472944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.473977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.474898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.475829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.476970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.477981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.478990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:49:27.479648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.479648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.480835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.481067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.481313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.481547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.481782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.482013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.482255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.482499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.482726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.482966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.483254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.483519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.483787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.484032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.484266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.484501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.484735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.484967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.485202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.485434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.485674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.485907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.486148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.486380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.486622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.486855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.487095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.487321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.487572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.487805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 05:49:27.487974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80338) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 05:49:27.509362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.509590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.509816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.514994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.515225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.515451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.518099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.524730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.546220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.546446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.550796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.551028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.689420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.692995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.738519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.738753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.740202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.740440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.802940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.803206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.803441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.803525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.804198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.804353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.804523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.804606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.804974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.805198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.805414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.805626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.829784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.830999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.831128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.831211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.831341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.842256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.842960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.854958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.855193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.855418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.855671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.855893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.855975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.856791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.857005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.857219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80338) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 05:49:27.873940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.874152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:49:27.874488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.874692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:49:27.874773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.874904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:49:27.874987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 05:49:27.875498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.875975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.876229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.876482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.887327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.887633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.887900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.888178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.889112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.889390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.889657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.889974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.896390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.898641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.899832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.900117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.900398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.900790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.901078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.901343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.901615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.901889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.902158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.902285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.902430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.902563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.902698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.902842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.903232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.903517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.903805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.904079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.904361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.904630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.904901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.905170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.930353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.932031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.932309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.933667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.935270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.935545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.937559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.937846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.938130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.940847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.941084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.941363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.946128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.946411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.949646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.949925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.951036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.951325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.951632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.951917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.952191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.952466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.952739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.953007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.954511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.954795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.955076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.955354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.955648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.955922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.956191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.956455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.971823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.972103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.976070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.976360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.976951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.980635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.980930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.981016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.984623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.984915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.985972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.989618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.989907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.994060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.994361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.994505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:27.994656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.994948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.995224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.995503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.998281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.998576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.998855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.999144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.999418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:27.999719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.015047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.015422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.015720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.015988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.019602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.019975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.020246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.020507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.024227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.025937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.026212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.028905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.029312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.029592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.029872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.030150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.030481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.030629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.030903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.033976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.034256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.034533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.034807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.035087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.044056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.044338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.044620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.044911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.045192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.045480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.045754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.049053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.049333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.049608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.049883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.050413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.050694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.050964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.065827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.069148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.072342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.073060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.074682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.075609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.076351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.076629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.076913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.078896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.080509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.082126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.082410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.082694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.084415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.086172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.089449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.089740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.090023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.090305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.090813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.092526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.095787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.096076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.096355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.096626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.099611 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.099903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.100184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.106933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.107218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.107497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.108657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.108935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.109223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.109500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.109773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.110046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.110323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.110602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.110942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.111216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.111545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.111831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.112159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.112437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.115601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80338) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 05:49:28.115882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.117132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.117422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.117695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.117965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.118240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.118516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.118789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.119056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.119322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.119607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.119871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.120139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80338) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 05:49:28.150795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558e5cc829c0 pid: 80337 (default app) Jul 25 05:49:28.154161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0b76-10c9-4f24-93d9-8a0953174822 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:28.154457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0b76-10c9-4f24-93d9-8a0953174822 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:28.154738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a0b76-10c9-4f24-93d9-8a0953174822 None None] PATH_INFO: `/v3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:28.158904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Mon Jul 25 05:49:28 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:28.161699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x558e5cc829c0 pid: 80338 (default app) Jul 25 05:49:36.888304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:36.888867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:36.888867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:36.890182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:49:36.897664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:36.898089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:36.898333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:36.966881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: INFO dbcounter [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] Registered counter for database keystone Jul 25 05:49:36.987771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG oslo_db.sqlalchemy.engines [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80338) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:36.994510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writer thread running {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:37.171617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG passlib.handlers.bcrypt [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80338) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 05:49:37.171967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG passlib.handlers.bcrypt [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80338) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 05:49:37.226826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:37.228516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:37.349774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1/3] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 05:49:37.520423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:37.590097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: INFO dbcounter [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] Registered counter for database keystone Jul 25 05:49:37.609582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG oslo_db.sqlalchemy.engines [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 05:49:37.616320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writer thread running {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 05:49:37.737407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642371b4-d0b6-425e-85f4-ff5f722d0f51 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:37.742473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:37.743140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:37.743430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:37.743749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:37.751879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:37.805185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING keystone.common.rbac_enforcer.enforcer [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 05:49:37.805469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480caa52-0b31-47e3-9fae-bf285afbc57e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:37.815019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Jul 25 05:49:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 05:49:37.821238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:37.836468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd9d73-7a4f-41dc-bf23-52c356fece48 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:37.840871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:37.842006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:37.842298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:37.842579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] PATH_INFO: `/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:37.846650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=1ff9f2a23bd646d2af236b8a1efad9a1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:37.898409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 05:49:37.898950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065b6c4-10e8-4c5a-b79a-70eb424811f7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:37.903415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 2/5] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Jul 25 05:49:37 2022] GET /identity/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:39.895849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3d45-8dc8-4558-871d-4a617df1c82a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:39.896363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3d45-8dc8-4558-871d-4a617df1c82a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:39.896463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a3d45-8dc8-4558-871d-4a617df1c82a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:39.900477 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 4/6] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:39.905828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:39.906284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:39.906406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:39.925112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:39.926628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:39.934986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 3/7] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 05:49:39.958013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3d45-8dc8-4558-871d-4a617df1c82a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:39.970095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a3d45-8dc8-4558-871d-4a617df1c82a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:39.974294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:39.974930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:39.975258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:39.975513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:39.983450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:39.985254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b522a-6b16-440e-bc17-ccdfb2945a6a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:39.994672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 5/8] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Jul 25 05:49:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 05:49:39.999954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:40.009642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c005-04d2-4ccc-a6b7-80a3a47b049d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:40.014091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:40.014952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:40.015239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:40.015521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:40.016945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:40.018767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab0c7b-e58c-4fce-b5d6-9f057f80737f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:40.020339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 4/9] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Jul 25 05:49:39 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:42.086313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4cc0d-fd64-4ed2-9378-d9c2abfde968 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.086803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4cc0d-fd64-4ed2-9378-d9c2abfde968 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.086883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4cc0d-fd64-4ed2-9378-d9c2abfde968 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.088267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:42.093488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.093926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.094067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.111234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:42.112471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:42.135528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e48d-8313-4056-b11d-7cc466ff7203 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.135850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e48d-8313-4056-b11d-7cc466ff7203 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.136131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e48d-8313-4056-b11d-7cc466ff7203 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.137467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 7/11] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:49:42.142503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.142794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.143071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.184025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG passlib.handlers.bcrypt [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80337) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 05:49:42.184447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG passlib.handlers.bcrypt [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80337) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 05:49:42.195413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 5/12] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:42.218477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.230907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:42.232514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:42.242197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.321198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588321b3-6fa7-4660-a424-8cdcb86ac9eb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.332079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 8/13] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:49:42.354583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.355101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.355940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.356229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.356508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.367810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:42.378884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:42.379956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:49:42.380770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 6/14] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:49:42.386514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.455476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e975e60-bffe-45f1-94e4-98ba51364cef None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.457768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.469352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.485961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e0f5-f159-4732-8cc5-c867b1866e7c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.493617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.494518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.494809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.495090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.520480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.521143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.521433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.521715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.522765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:42.523077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.524497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.536122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 7/15] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:42.542465 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.564644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.566181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.644400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99d313-80e7-43d0-a379-dffc3905d3fd None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.666881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 9/16] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:49:42.673207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.676212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.679998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.680890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.681347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.681768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.683003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.684494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.686266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 8/17] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:42.691342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.706283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.775711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f64cae-79a1-4655-b552-0256b0e71337 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.792190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4c0e8-7e8a-4775-9ba5-73e2addb890f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.809918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.810712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.811003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.811285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.825455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.826253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.826541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.826821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.828038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.829492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.830733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.831093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:42.832220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.837643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:49:42.854110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:42.854945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:42.855959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:49:42.855959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:49:42.855959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:49:42.855959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:42.855959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:49:42.860921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:42.917142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.919257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:42.937810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e17699-a6b7-44e4-bc29-fda9b496d281 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.961033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f07f18-b9b9-4ea3-955d-ae9636d8e4c8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:42.970763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.971429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.971742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.972033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.972867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.domain.id=default, user.id=606c52ef106342ea90cee3defca6b7ff) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:42.973180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.974628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b5617-3e33-42e6-9c1e-00b5a146d97b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:42.982570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/role_assignments?user.id=606c52ef106342ea90cee3defca6b7ff&scope.domain.id=default&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:42.995229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:42.995964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:42.996252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:42.996530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:42.997285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:42.997595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:42.999040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d5a86-0478-4921-a9b8-11c77790c9c2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:43.018707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 11/21] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:45.377397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcb07-f0f7-4705-840a-08961e93b411 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.378381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcb07-f0f7-4705-840a-08961e93b411 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.378873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bcb07-f0f7-4705-840a-08961e93b411 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.380496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:45.386945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.387392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.387503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.413521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:45.414979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:45.511851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 12/23] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:45.547414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bcb07-f0f7-4705-840a-08961e93b411 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:45.694030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091bcb07-f0f7-4705-840a-08961e93b411 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:45.744892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:45.745715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.746003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.746284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.761766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-7cc6e366-3f5b-455e-bf54-6b80082a36e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:45.769570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:45.770393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:49:45.771125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 12/24] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:49:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:45.779470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:45.784103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e143d-c665-44a6-900a-eb9f69337067 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.784402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e143d-c665-44a6-900a-eb9f69337067 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.784693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e143d-c665-44a6-900a-eb9f69337067 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.786325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 13/25] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:45.792036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5b6b6-cc5e-4a58-bdd6-f7c0b37d56f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.792352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5b6b6-cc5e-4a58-bdd6-f7c0b37d56f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.792637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5b6b6-cc5e-4a58-bdd6-f7c0b37d56f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.811183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:45.822438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-63a5b6b6-cc5e-4a58-bdd6-f7c0b37d56f3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:45.823682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-63a5b6b6-cc5e-4a58-bdd6-f7c0b37d56f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:45.877669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:45.956419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780130-3f19-4e65-9bea-d48301d03245 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:45.985342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 14/26] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:45.986488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d1b1-165c-48e3-a8e7-e631a7f50583 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.986790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d1b1-165c-48e3-a8e7-e631a7f50583 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.987251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966d1b1-165c-48e3-a8e7-e631a7f50583 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:45.988701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 15/27] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:45.995331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89f37-3477-4b0f-bc0f-3c60d50f9436 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:45.996006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89f37-3477-4b0f-bc0f-3c60d50f9436 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:45.996530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf89f37-3477-4b0f-bc0f-3c60d50f9436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.010356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.011292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.011769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.012185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.013086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:46.013546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.015513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.036545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dcf89f37-3477-4b0f-bc0f-3c60d50f9436 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:46.041387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dcf89f37-3477-4b0f-bc0f-3c60d50f9436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:46.047151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 13/28] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:46.048085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.128954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 16/29] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:46.130862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf54a5-f0ba-44be-8f45-9d2fa7f486ae None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.132358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf54a5-f0ba-44be-8f45-9d2fa7f486ae None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.132902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf54a5-f0ba-44be-8f45-9d2fa7f486ae None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.134449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 17/30] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:46.135326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf54a5-f0ba-44be-8f45-9d2fa7f486ae None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.182392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e034ef5-95b1-4053-adb4-2b2c6a8c639c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.192043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:46.215714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:46.217789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.218756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.219191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.219717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.231616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.236607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-184d8fd9-0872-4ff2-8815-9c8d84e89b14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:49:46.253282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:46.254291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:46.255280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:49:46.255280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:49:46.255280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:49:46.255280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:46.262239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 14/31] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:46.262384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf54a5-f0ba-44be-8f45-9d2fa7f486ae None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.263821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.264239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.264683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.281970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:46.283455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:46.299895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480d37-db72-454a-92cc-17271376c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.300899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480d37-db72-454a-92cc-17271376c613 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.301239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480d37-db72-454a-92cc-17271376c613 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.301577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480d37-db72-454a-92cc-17271376c613 None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.303022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480d37-db72-454a-92cc-17271376c613 None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.305712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480d37-db72-454a-92cc-17271376c613 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.311717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 18/32] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:46 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:46.312721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480d37-db72-454a-92cc-17271376c613 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.357618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 15/33] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:46.358913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.423734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480d37-db72-454a-92cc-17271376c613 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.453947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:46.457187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:46.463222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291d3-d649-4289-9179-017203e6267e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.463952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291d3-d649-4289-9179-017203e6267e None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.464243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291d3-d649-4289-9179-017203e6267e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.464519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114291d3-d649-4289-9179-017203e6267e None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.465237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4d53-890f-4b78-b83c-f8bc5f69ae02 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.465340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114291d3-d649-4289-9179-017203e6267e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.466691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114291d3-d649-4289-9179-017203e6267e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.500921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.501688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.501975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.502251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.502968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:46.503269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.504706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.516837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 16/34] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:46.521788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.633359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdc5b-fa0c-41ed-9187-ab5e688140ea None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.669439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.670242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.670532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.670814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.672316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.673770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.675926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 17/35] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:46.679669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.686249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 19/36] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jul 25 05:49:46 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:46.687293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291d3-d649-4289-9179-017203e6267e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:46.703882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:46.801069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56252fc-3a8f-45f7-94f0-45edacc49a2d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.809840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114291d3-d649-4289-9179-017203e6267e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:46.842244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.842978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.843271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.843572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.844379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.845851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c8a51-4911-43ff-8ba3-04734afece7a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.850592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:46.852042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.852406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.852681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.853341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:46.854937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd6e9e5-e5a0-409b-b141-01bbbe21c24c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:46.958630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 20/37] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:49:46 2022] POST /identity/v3/projects => generated 301 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:46.960272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09ab-0fed-4d02-8fbb-e3936f55705a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:46.960555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09ab-0fed-4d02-8fbb-e3936f55705a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:46.960845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b09ab-0fed-4d02-8fbb-e3936f55705a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:46.962309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 21/38] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:46.962820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b09ab-0fed-4d02-8fbb-e3936f55705a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:47.044131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 18/39] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jul 25 05:49:46 2022] POST /identity/v3/roles => generated 219 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:47.051725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca93ed-f22b-413e-ba6d-c334fc692f05 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.051725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca93ed-f22b-413e-ba6d-c334fc692f05 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.051725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca93ed-f22b-413e-ba6d-c334fc692f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.075262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2cca93ed-f22b-413e-ba6d-c334fc692f05 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:47.077408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2cca93ed-f22b-413e-ba6d-c334fc692f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:47.134734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:47.176017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 19/40] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:47.177861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc34b-2800-4b08-b222-16c29308cfa1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.178244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc34b-2800-4b08-b222-16c29308cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.178531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dc34b-2800-4b08-b222-16c29308cfa1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.180109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 20/41] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:47.189069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.189358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.189648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.213407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:47.214717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:47.217820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b09ab-0fed-4d02-8fbb-e3936f55705a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:47.218015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:47.267982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:47.268904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.269180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.269469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] PATH_INFO: `/v3/domains/default/users/606c52ef106342ea90cee3defca6b7ff/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.271706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=606c52ef106342ea90cee3defca6b7ff, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:47.274153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:47.294754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 21/42] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:47.295625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:47.340967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 22/43] 10.222.0.36 () {58 vars in 1361 bytes} [Mon Jul 25 05:49:46 2022] PUT /identity/v3/domains/default/users/606c52ef106342ea90cee3defca6b7ff/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:49:47.341740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:47.401885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e078e8f-c0cf-47a4-987b-83466549377e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:47.443870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:47.444656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.445096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.445378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.446158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:47.447736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:47.464243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbb49e-96d5-4000-ae50-f81e5e9cb199 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:47.467022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:47.490024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:47.501754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 22/44] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jul 25 05:49:47 2022] POST /identity/v3/roles => generated 223 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:47.505472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:47.506443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.506804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.507090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.508482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:47.520752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2e85-f95a-44e5-9eae-4945bad3a4ed None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:47.520752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 23/45] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:47.521241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:47.633824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ad50f-18c2-484e-bde7-dcc831f11eb7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:47.671662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:47.672345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:47.672635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:47.672913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:47.673625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:47.675456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe53d-d461-4fd5-a35a-702100144de9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:47.781532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 23/46] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:49:47 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:49.390759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dbe2-8f34-4597-86dc-c0ac5803c140 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.391255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dbe2-8f34-4597-86dc-c0ac5803c140 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.391255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6dbe2-8f34-4597-86dc-c0ac5803c140 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.392676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 24/47] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:49.398464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.398866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.399134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.415588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:49.416755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:49.463595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:49.483148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:49.507284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6dbe2-8f34-4597-86dc-c0ac5803c140 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:49.609529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6dbe2-8f34-4597-86dc-c0ac5803c140 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:49.642616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:49.643347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.643668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.643952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.654680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-172b968b-dfd4-4d1a-bfe3-2d9555e33503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:49.662991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:49.664116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:49:49.664891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 25/49] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:49.670262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:49.831669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a4ed-2a32-4676-834e-56cadfba1f60 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.831963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a4ed-2a32-4676-834e-56cadfba1f60 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.832254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85a4ed-2a32-4676-834e-56cadfba1f60 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.833630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 26/50] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:49:49.839369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.839690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.839975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.857534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:49.859049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:49.875621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493672b9-235b-4dd2-aced-481f7a0f4a16 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:49.885471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:49.909602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:49.910205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:49.910499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:49.910785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:49.911534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:49.911881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:49.913325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:49.921475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 25/51] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:49.926333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:49:49.927466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:49.949582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:49.971505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:50.027709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41684c07-94ef-4988-9bd7-a7cb35123393 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.049411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2f2fd-24a6-4dd9-8327-eb96c07c254d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.063409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.064319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.064609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.064895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.066329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.067796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.070402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:49 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:50.075677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:50.083525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.084918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.085209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.085583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.086686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.088218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.089846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 28/54] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:50.095144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:50.125069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:50.178152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b511a5-170e-41cd-8ba3-beec5b65d549 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.188318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:50.197737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbcac3-a0d3-4ea2-aeb6-1885295f3ca9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.316132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.316132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.316132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.316132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.316533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.316533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.316533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:50.316533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:50.316827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.316827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.316827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.316827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.317130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.317130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70ace3-b66e-4e8a-99ff-14bb9985c84a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.328987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc0721-4ad4-41b2-90c6-94fcae53182f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:50.346526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 29/56] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Jul 25 05:49:50 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:49:50.364153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:50.364842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:50.365130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:50.365410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:50.366668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.domain.id=default, user.id=606c52ef106342ea90cee3defca6b7ff) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:50.366988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:50.368641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24218a72-0bcc-44db-9394-9af1f4bdd4c3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:50.379182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Jul 25 05:49:50 2022] GET /identity/v3/role_assignments?user.id=606c52ef106342ea90cee3defca6b7ff&scope.domain.id=default&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:49:52.384134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae3100-c261-4123-9396-383f6d2ec0b2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:52.384616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae3100-c261-4123-9396-383f6d2ec0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:52.384616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae3100-c261-4123-9396-383f6d2ec0b2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:52.385991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 30/58] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:52.391062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:52.391438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:52.391653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:52.408968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:52.410146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:52.444735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:52.475868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:52.500101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae3100-c261-4123-9396-383f6d2ec0b2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:52.582024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:52.601538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae3100-c261-4123-9396-383f6d2ec0b2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:52.634050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:52.634880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:52.635121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:52.635403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:52.636595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:52.638047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6999eb4-07ee-4cbc-bd0e-54daae92f215 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:52.639658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 31/60] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:52.645151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:52.742140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9af5c-a7b7-46d6-9b75-2c76bb584852 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:52.775023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:52.775718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:52.776011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:52.776295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:52.777004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:52.778496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a79929-77fe-4c1b-9ea4-6a6ed7edce49 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:52.869794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 30/61] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:49:52 2022] POST /identity/v3/users => generated 275 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:56.072923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd1df-d6c3-4ed6-be38-bf2f86b046df None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.073787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd1df-d6c3-4ed6-be38-bf2f86b046df None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.074216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdd1df-d6c3-4ed6-be38-bf2f86b046df None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.075768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 32/62] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:56.081052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.081825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.082343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.108614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:56.110049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:56.146353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.151163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaecb1-8987-4b51-901d-5aff968112a9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.151757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaecb1-8987-4b51-901d-5aff968112a9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.152248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaecb1-8987-4b51-901d-5aff968112a9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.153938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 33/63] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:49:56.160875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236c3-119e-48c3-af88-7df27ee9c8b6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.160875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236c3-119e-48c3-af88-7df27ee9c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.160875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d236c3-119e-48c3-af88-7df27ee9c8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.189322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c4d236c3-119e-48c3-af88-7df27ee9c8b6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:56.190839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c4d236c3-119e-48c3-af88-7df27ee9c8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:56.219660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 31/64] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:56.243648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.338512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 34/65] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:56.342994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4e46-d262-43e0-b96a-b5a897302b76 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.343289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4e46-d262-43e0-b96a-b5a897302b76 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.343585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a4e46-d262-43e0-b96a-b5a897302b76 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.345273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 35/66] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:49:56.350808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.351286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.351757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.352071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd68dc-0b1b-4a6b-8ed7-65cecd840a40 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.383974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:56.385378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:56.387847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.388785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.389150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.389510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.402118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:56.411406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:56.413272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:49:56.414260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:56.416546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 32/67] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:49:56.417642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.440114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.470605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 36/68] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:49:56.471454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.491931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.532818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3adc1-e6d8-4859-9438-fed679f42928 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.569175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.569986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.570280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.570567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.582022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3d01e876-ae11-4399-a18a-7946b9446726 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:56.590947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:56.592093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:49:56.592855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:56.593437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a817f39-fbbd-4bdb-a6fb-db2f39c20149 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.593506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 33/69] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:56.593506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb8c9-8c75-4e97-bb07-2fb4af71b354 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.593632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb8c9-8c75-4e97-bb07-2fb4af71b354 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.594408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfeb8c9-8c75-4e97-bb07-2fb4af71b354 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.595416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 34/70] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:56.600435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeb8c9-8c75-4e97-bb07-2fb4af71b354 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.638622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.639308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.639631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.640552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.640672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:56.640958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:56.642357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:56.656343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 37/71] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:56.656343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.691883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.717000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfeb8c9-8c75-4e97-bb07-2fb4af71b354 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.732342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.753130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.753933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.754222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.754499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.761734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bc0d1-39bb-4365-9cea-50206b734113 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.766043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-395c4099-21b6-459a-99e5-d5d23d8b007c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:56.774309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:56.775909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:56.776661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 35/72] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:56.777299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e83d-caa0-459b-8fe9-efafbc316ff7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.777299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e83d-caa0-459b-8fe9-efafbc316ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.777299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7e83d-caa0-459b-8fe9-efafbc316ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.793323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1bf7e83d-caa0-459b-8fe9-efafbc316ff7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:56.794546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1bf7e83d-caa0-459b-8fe9-efafbc316ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:56.798924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350498-094b-4808-9c00-66965a291901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.801650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350498-094b-4808-9c00-66965a291901 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.801650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350498-094b-4808-9c00-66965a291901 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.801650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42350498-094b-4808-9c00-66965a291901 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.801650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42350498-094b-4808-9c00-66965a291901 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:56.801650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42350498-094b-4808-9c00-66965a291901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:56.802878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42350498-094b-4808-9c00-66965a291901 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:56.810939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 38/73] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:56.812566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350498-094b-4808-9c00-66965a291901 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.863036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 36/74] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:56.864485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe369aa-43bf-4f7a-b196-86e7f4313e25 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.864792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe369aa-43bf-4f7a-b196-86e7f4313e25 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.865128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe369aa-43bf-4f7a-b196-86e7f4313e25 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.871522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 37/75] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:49:56.871522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe369aa-43bf-4f7a-b196-86e7f4313e25 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:56.932180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42350498-094b-4808-9c00-66965a291901 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.965720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.973491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:56.974386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:56.975220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:56.975730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:56.977865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:56.986458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe369aa-43bf-4f7a-b196-86e7f4313e25 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:56.990935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:56.992468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:56.994376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 39/76] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:56.994931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.028232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.028919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.029213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.029500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.030301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:57.030616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.032052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf49ae-db31-4689-ae8b-b07f4823e807 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.041206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 38/77] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.042428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.042729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.043073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.061143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:49:57.062515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:49:57.109993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e1ebe-5c29-4900-a81e-32b29140c75d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.143641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:49:57.143641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.156839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.156839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.157812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.157812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.158865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.160359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.162545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:56 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.163393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.215087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.228040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.255671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c8ebf-1b90-4c16-9ac3-c6172389c9e1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.268982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd2e95-5ddc-4771-a25c-868f742d502c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.290140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.290943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.291229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.291508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.301941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:49:57.303997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.304650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.304943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.305227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:49:57.309883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:49:57.310906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 40/80] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:49:57.311959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.376227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.377695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.410380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9f24-374e-4cbd-9619-506250a44836 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.429759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.433947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.444254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.445127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.445409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.445685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.446877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.448364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.449999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.450751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.477039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 41/82] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:57.477894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.549896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21742-7b32-468d-8664-7489d013d845 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.577454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ee6fc-4322-4334-af75-9be63958d725 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.582773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.583602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.583898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.584751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.586301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.587784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.589416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 42/83] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.594049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.611859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.612516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.612805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.613087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.640607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.648496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.680797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.682806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.691184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2f293-780f-42cf-b1bf-00e7b8853b75 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.726070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.726740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.727029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.727320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.728097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:57.728407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.729770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.737746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 43/84] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.738540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.793787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 42/85] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:57.794649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.838667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c665f-a538-4606-8058-68f139345043 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.855669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.856017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:57.872417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.873075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.873368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.873661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.896006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d037fff-f55e-4590-a90a-4ea555d47191 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:57.930979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:57.931807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:57.932095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:57.932381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:57.933554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.934983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:57.936695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 43/86] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:57.937432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:57.945477 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:57.946944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.042773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c759f6-1682-44ef-989e-1aa20d79e728 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.045214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 44/87] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:58.046054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.065947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.070121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.078400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.079077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.079366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.079684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.080401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.081834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.146133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a05ea6-190f-4a2d-ab95-247fbf3215f2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.181196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.181984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.182276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.182562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.183845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.185302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.186935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 45/88] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:58.187732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.198838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 44/89] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:49:57 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:49:58.199717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.296680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.314109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdec32a-9698-44c4-8e16-54f017de2c25 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.319908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72fad6-b246-40cd-8abe-10dffcc19ef2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.357661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.358696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.358989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.359271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.360495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.361354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.361960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.362077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.362317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.362601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.363439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:58.363759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 46/90] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:58.363867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.365102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.369750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.379131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 45/91] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=dfc30452d78d40f6911291710cd6601e => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:58.379131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.451505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.520462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b849c8-7fea-4ae1-ae67-506c16d18e26 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.532753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0201bc-57d0-46c3-b7b3-81b6bddb3156 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.571153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.572067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.572359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.572644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.573856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.575316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.577321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:58.578111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.578933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.579798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.580224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.580942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.611595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.670432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.671967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.704606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30137a4e-927a-4202-b40c-7f1fe9ad934b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.725996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.741398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:58.742077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:58.742368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:58.742653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:58.743498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:58.743931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:58.745387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:58.751413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 48/93] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=806a50b089f44cb48562ccf8ff703763 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:58.752580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.785680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 46/94] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:49:58.796902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:58.913806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:49:58.935288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486880b-4b02-4ec4-9f0f-20c8946ca726 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:58.997882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a108d-e0d4-491d-afc9-535735f3703b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:59.008974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:59.009951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:59.010461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:59.011004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:59.012135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=606c52ef106342ea90cee3defca6b7ff) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:59.012656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:59.014341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:59.024557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 49/95] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/role_assignments?user.id=606c52ef106342ea90cee3defca6b7ff&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:59.067338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:59.068912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:59.069258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:59.069543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] PATH_INFO: `/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:59.076602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] RBAC: Authorizing `identity:get_project(project_id=f340854d7cfb46b3aec7b85f31b4e7b2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:59.078129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab50a-9aa8-4096-9526-755d3a2ea263 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:59.080334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 47/96] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:49:58 2022] GET /identity/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2 => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:49:59.087147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:49:59.225326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e9eea-55e6-4ac1-a462-8e7e8697bfc5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:49:59.261910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:49:59.262507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:49:59.262797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:49:59.263083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:49:59.263967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=f340854d7cfb46b3aec7b85f31b4e7b2, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:49:59.264285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:49:59.265760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d2e6a-b9e3-4ef0-a56b-417927e6c46f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:49:59.273376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 50/97] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:49:59 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=f340854d7cfb46b3aec7b85f31b4e7b2&role.id=dfc30452d78d40f6911291710cd6601e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:01.046485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8640-2e4f-48f2-8a90-d4f12c1f7396 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.047287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8640-2e4f-48f2-8a90-d4f12c1f7396 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.047789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d8640-2e4f-48f2-8a90-d4f12c1f7396 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.049647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 48/98] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:01.055303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.056158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.056655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.076525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:01.078018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:01.088592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:01.164180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:01.202269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d8640-2e4f-48f2-8a90-d4f12c1f7396 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:01.226621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:01.315531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d8640-2e4f-48f2-8a90-d4f12c1f7396 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:01.352409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:01.353549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.354086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.354562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.366067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f423bf20-1e3d-44a6-93a0-45465f714214 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:01.374117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:01.374952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:01.375734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:01.378070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 49/100] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:01.384691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:01.435590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1a55-5665-4aca-a8e6-252792d532c1 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.436206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1a55-5665-4aca-a8e6-252792d532c1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.436707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002d1a55-5665-4aca-a8e6-252792d532c1 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.438685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 50/101] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:01.444616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.445143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.445728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.480567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:01.482134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:01.504695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2232ae-2f1e-4df7-8dcb-01db85811553 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:01.547971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:01.548655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.549172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.549720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.550475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:01.550783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:01.552203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:01.584394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 52/102] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:01.590458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:01.612114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:01.614108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 51/103] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:01.665544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:01.673920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:01.777996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1a370-1324-4560-8761-96d7cc1d37d9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:01.823704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:01.824595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.824879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.825157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] PATH_INFO: `/v3/users/cc80141f2c7045cab01f9c45977ee427` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.866273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cc80141f2c7045cab01f9c45977ee427)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:01.867707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:01.874100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:01 2022] GET /identity/v3/users/cc80141f2c7045cab01f9c45977ee427 => generated 289 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:01.877661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:01.894888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b7451-5015-4e5e-bff8-5d3960a8fb75 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:01.954285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:01.955153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.955437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.955788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.957493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:01.959893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc49e450-58d4-4437-b466-31406e761ac5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:01.962641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 52/105] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:01.964724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c47b-c28f-408b-a359-1b89627628f7 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.965023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c47b-c28f-408b-a359-1b89627628f7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.965306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286c47b-c28f-408b-a359-1b89627628f7 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.966920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:01.968640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 53/106] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:01.969619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cda52-32f0-4256-b6e8-cbf723ecc365 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:01.969905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cda52-32f0-4256-b6e8-cbf723ecc365 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:01.970184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cda52-32f0-4256-b6e8-cbf723ecc365 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:01.972497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 54/107] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:01.973226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cda52-32f0-4256-b6e8-cbf723ecc365 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.018595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219bffd-fa88-4c26-a2be-1c5d2959aaf5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.065193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.066583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.067081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.067535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.081402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.118863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cda52-32f0-4256-b6e8-cbf723ecc365 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:02.159322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f117aa4-44cf-4175-aa69-857f2c490646 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:02.166305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.167758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.168749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.169241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.170160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:02.172809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291eb278-c25d-475a-810b-54bf015d0086 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:02.224162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.266721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 55/108] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:50:01 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:02.266721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e13db-4ef1-4195-9b6a-2ffe21d7fd09 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.266721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e13db-4ef1-4195-9b6a-2ffe21d7fd09 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.266721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e13db-4ef1-4195-9b6a-2ffe21d7fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.272637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 54/109] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:02.273994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f01a-71ab-4d36-bf1f-a6017e3352ed None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.274291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f01a-71ab-4d36-bf1f-a6017e3352ed None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.274669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838f01a-71ab-4d36-bf1f-a6017e3352ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.289370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-738e13db-4ef1-4195-9b6a-2ffe21d7fd09 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:02.290627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-738e13db-4ef1-4195-9b6a-2ffe21d7fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:02.293821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8838f01a-71ab-4d36-bf1f-a6017e3352ed None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:02.295070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8838f01a-71ab-4d36-bf1f-a6017e3352ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:02.367116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 56/110] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:02.368349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72afe6-a65c-4fbe-bc4b-2a3a87ab3973 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.368647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72afe6-a65c-4fbe-bc4b-2a3a87ab3973 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.368982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72afe6-a65c-4fbe-bc4b-2a3a87ab3973 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 57/111] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8319-ef35-4b7f-84bc-3d1a146e1806 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8319-ef35-4b7f-84bc-3d1a146e1806 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf8319-ef35-4b7f-84bc-3d1a146e1806 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 58/112] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:02.374306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf8319-ef35-4b7f-84bc-3d1a146e1806 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.384145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 55/113] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:02.386019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb36fb8-4239-40a1-a8fe-a4708cbd1278 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.386581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb36fb8-4239-40a1-a8fe-a4708cbd1278 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.387072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb36fb8-4239-40a1-a8fe-a4708cbd1278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.406440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ddb36fb8-4239-40a1-a8fe-a4708cbd1278 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:02.408264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ddb36fb8-4239-40a1-a8fe-a4708cbd1278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:02.458734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.486558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 56/114] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:02.487877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.488171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.488450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.510580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:02.511785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:02.520613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf8319-ef35-4b7f-84bc-3d1a146e1806 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.530872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.558595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.559463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.559792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.560059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.561245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:02.562688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:02.567804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 59/115] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:02.567804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.592096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 57/116] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:02.592923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.689846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2648f5-933b-4187-82f7-4341c567ba8d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.696888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7af49-5843-4e12-a356-fc99b8c67f48 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.715850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.727368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.728262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.728545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.732077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.734758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.735580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.735865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.736143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.740262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:02.746712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:02.748845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:02.749991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 60/117] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:02.750749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:02.759785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:02.760664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:02.761479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 58/118] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:02.762108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.778716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:02.860800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f81ed2-16be-4123-be95-a1429e95fbdf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.870774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14103d6c-c154-4765-bcba-a92e278052b4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:02.898196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.899005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.899291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.899589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.908014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:02.908682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:02.908977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:02.909411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:02.909915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:02.910369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=cc80141f2c7045cab01f9c45977ee427) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:02.910689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:02.912221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:02.923965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 59/119] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/role_assignments?user.id=cc80141f2c7045cab01f9c45977ee427&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:02.924141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:02.925292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:02.926128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:02.926721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.926788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 61/120] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:02.926788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:02.991339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.020981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.047302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78afe-118d-4f51-b805-8b702af687cb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.077290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632e6e-f68a-4093-83b4-82470eb66d93 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.090438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.092071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.092583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.093055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.107384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:03.116717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:03.117633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:03.118392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 60/121] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:03.119003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.125970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.127470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.127990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.128470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.129532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:03.130047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.132631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.142593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 62/122] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.148222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.238843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21998a21-0b7a-476a-9c17-58ab175a4d18 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.263617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c10c4-fd52-4507-99bd-73dc1047ce26 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.272840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.276770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.277758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.278247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.278746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.279741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:03.280251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.281848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.288507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.292853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 61/123] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.294033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.303917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.304610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.304904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.305193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.306126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:03.306445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.308152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.317766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 63/124] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.322484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.412209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a28987-5baa-46d9-b5d4-74ffe7db5a25 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.434069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c996de-6bd2-4857-9e0e-6f17e7bbd669 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.453484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.454177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.454473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.454758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.455520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:03.455877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.457266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.467528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 62/125] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.468420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.475682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.476852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.477371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.477901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.479923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.482489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.484721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 64/126] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.485950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.541078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.545081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.589528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ec3d1-5e47-4953-8d07-e5f7310f7b9c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.618061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad7450f-bd35-49c0-95bc-bf03b5e0d7bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.625705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.626773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.627248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.627753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.629134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.630979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.632837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 63/127] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.633855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.657709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.658727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.659098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.659458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.660840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.663298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.665251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 65/128] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.670079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.748954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283edfe-ff45-4702-824c-58eb6b3eb9ca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.776856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed43cd-c330-4c03-b38a-3a3b5880b8b8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.779223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.779952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:03.786032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.787978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.788647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.789127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.790640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.799745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.799745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 64/129] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.799745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.822095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.823198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.823374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.823786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.825188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.826715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.830978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 66/130] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.830978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.904909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30d0f3-8cc1-44e9-80fc-e3fd4d476b7e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.942211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.943644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.944244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.944703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.945987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402a2af-d352-4f2e-8d2f-1f6f09fe7458 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:03.946276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.948003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.950227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 65/131] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.951299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:03.983724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:03.984698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:03.985065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:03.985426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:03.986748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:03.988323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:03.990678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 67/132] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:03.991591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.025849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.039265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.063796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5616a9-5fda-4c58-bc89-15b04c882e33 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.106212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.107387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.107819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.108205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] PATH_INFO: `/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.109353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2098d285-e747-4ede-a3f7-6ddb09954006 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.109778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] RBAC: Authorizing `identity:get_project(project_id=f340854d7cfb46b3aec7b85f31b4e7b2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.111448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.114622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 66/133] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:03 2022] GET /identity/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:04.115683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.150725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.152372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.152920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.153343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/users/dfecdb7e62f643c1b9699f84f4b27372/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.155655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, user_id=dfecdb7e62f643c1b9699f84f4b27372, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.157370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.233897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 68/134] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:03 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/users/dfecdb7e62f643c1b9699f84f4b27372/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:04.234711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.235273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5065c-975c-4260-ad91-1d2df0437307 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.289141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.290062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.290356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.290641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/users/606c52ef106342ea90cee3defca6b7ff/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.297118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, user_id=606c52ef106342ea90cee3defca6b7ff, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.302062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.308309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.364828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.370197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64edce-0002-414b-b1ed-3f6d12930229 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.409004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.410297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.410789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.411371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/users/dfecdb7e62f643c1b9699f84f4b27372/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.415030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, user_id=dfecdb7e62f643c1b9699f84f4b27372, role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.416887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58723818-cc9c-4229-a51c-b4408b1dcdaf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.426692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 67/135] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:04 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/users/606c52ef106342ea90cee3defca6b7ff/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:04.431793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.486907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 69/136] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:04 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/users/dfecdb7e62f643c1b9699f84f4b27372/roles/806a50b089f44cb48562ccf8ff703763 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:04.488124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad774b-07ba-478d-9b61-a3196103ed79 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.488425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad774b-07ba-478d-9b61-a3196103ed79 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.488709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad774b-07ba-478d-9b61-a3196103ed79 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.490243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 70/137] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:04.496890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.497456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.498256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.531856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:04.533732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:04.570256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a016-b343-4940-a415-b84598050055 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.613828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.614089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.614310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.614599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] PATH_INFO: `/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2/users/dfecdb7e62f643c1b9699f84f4b27372/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.617068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] RBAC: Authorizing `identity:create_grant(project_id=f340854d7cfb46b3aec7b85f31b4e7b2, user_id=dfecdb7e62f643c1b9699f84f4b27372, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.618553 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.649121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 71/138] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:04.675762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.705085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 68/139] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:04 2022] PUT /identity/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2/users/dfecdb7e62f643c1b9699f84f4b27372/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:04.781376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.792160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbfbc9-d5ee-4472-9468-52273f7dcc9c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:04.831643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:04.832629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:04.833027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:04.833420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:04.834900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:04.836597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fab2c1-f164-4e68-b690-b98044f87062 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:04.838650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 72/140] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:04.844074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:04.907030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:04.967911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c8758-90d0-4cdd-bfde-269e40156a6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:05.007975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:05.008808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:05.009209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:05.009588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:05.010413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:05.011985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18796ae-3cc9-487b-b8c5-eafccf5b190c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:05.099931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 69/141] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:04 2022] POST /identity/v3/users => generated 283 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:05.573729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7b6-f1a7-4e98-90d0-ac212837bebc None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:05.574287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7b6-f1a7-4e98-90d0-ac212837bebc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:05.574571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee52a7b6-f1a7-4e98-90d0-ac212837bebc None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:05.576125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 73/142] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:05.581536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:05.581940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:05.582292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:05.601625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:05.602811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:05.680115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 70/143] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:05.706093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a7b6-f1a7-4e98-90d0-ac212837bebc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:05.823424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee52a7b6-f1a7-4e98-90d0-ac212837bebc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:05.868524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:05.869727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:05.870250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:05.870732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:05.883710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:05.891884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:05.892752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:05.893558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:05.899924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 74/144] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:05.902607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:05.949502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:06.017533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38c8e1-e788-4223-ae5d-01062c012b08 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:06.057719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:06.058400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:06.058685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:06.059010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:06.059851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:06.060162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:06.061530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:06.072200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 71/145] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:06.077930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:06.102767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:06.198943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e3f0-3c08-461a-b113-ceb2aa68f7a4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:06.241802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:06.242688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:06.242972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:06.243253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] PATH_INFO: `/v3/users/cc80141f2c7045cab01f9c45977ee427` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:06.248324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] RBAC: Authorizing `identity:get_user(user_id=cc80141f2c7045cab01f9c45977ee427)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:06.249789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:06.251470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 75/146] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:06 2022] GET /identity/v3/users/cc80141f2c7045cab01f9c45977ee427 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:06.257433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:06.379038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc362f7-a96e-4310-89c4-1928d0a5b94d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:06.381284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:06.419651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:06.420545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:06.420827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:06.421104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:06.422322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:06.423808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae3401b-4888-48fa-87c5-c4accb086409 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:06.425966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 72/147] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:06 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:06.431951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:06.525313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:06.544352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7124fd95-4c56-4bc8-abf1-81804cd7228b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:06.582327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:06.583239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:06.583533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:06.584458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/users/cc80141f2c7045cab01f9c45977ee427/roles/ea4e76d231a34b46a40fbc85c2746da3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:06.588917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, user_id=cc80141f2c7045cab01f9c45977ee427, role_id=ea4e76d231a34b46a40fbc85c2746da3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:06.590377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2609-f0c1-414e-b04c-917235a61831 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:06.700777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 76/148] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:06 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/users/cc80141f2c7045cab01f9c45977ee427/roles/ea4e76d231a34b46a40fbc85c2746da3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:07.540955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d4b7-c059-4009-ac1b-77da62f98eda None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:07.541469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d4b7-c059-4009-ac1b-77da62f98eda None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:07.541564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506d4b7-c059-4009-ac1b-77da62f98eda None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:07.542937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 73/149] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:07.561450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a045aa-dc9f-4b5f-85bd-809959561641 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:07.561815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a045aa-dc9f-4b5f-85bd-809959561641 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:07.562032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a045aa-dc9f-4b5f-85bd-809959561641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:07.588596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-26a045aa-dc9f-4b5f-85bd-809959561641 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:07.589710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-26a045aa-dc9f-4b5f-85bd-809959561641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:07.673190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 77/150] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:07.714938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506d4b7-c059-4009-ac1b-77da62f98eda None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:07.779586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68289a38-09b6-45e7-8aa2-18acf0a9f81d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:07.780247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68289a38-09b6-45e7-8aa2-18acf0a9f81d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:07.780731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68289a38-09b6-45e7-8aa2-18acf0a9f81d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:07.782305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 78/151] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:07.788226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdf43-5496-48be-8a32-79c9e2439df7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:07.788797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdf43-5496-48be-8a32-79c9e2439df7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:07.789258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bdf43-5496-48be-8a32-79c9e2439df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:07.824275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-857bdf43-5496-48be-8a32-79c9e2439df7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:07.825775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-857bdf43-5496-48be-8a32-79c9e2439df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:07.863474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506d4b7-c059-4009-ac1b-77da62f98eda None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:07.924421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:07.925235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:07.925567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:07.925843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:07.951045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:07.962919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:07.963825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:07.964572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 74/152] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:07.978076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:07.984510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 79/153] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:08.027693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.029446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e603-8aec-4ed8-8c94-6075d524857f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.029972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e603-8aec-4ed8-8c94-6075d524857f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.030446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982e603-8aec-4ed8-8c94-6075d524857f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.036264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 80/154] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:08.038727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982e603-8aec-4ed8-8c94-6075d524857f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.052197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.151752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff48ae-80bb-4dd4-8abc-4034e8360f15 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.221219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982e603-8aec-4ed8-8c94-6075d524857f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.227997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.228681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.228967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.229350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.230104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:08.230428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:08.231808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4516c6-180b-4ecb-a75a-86f2ef19c4d7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:08.247672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 75/155] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:08.248933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.249221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.249497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.277791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:08.278853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.279074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:08.279705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.279994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.280274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.300969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:08.317137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:08.318163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 81/156] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:08.320449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.413493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 76/157] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:08.414195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.430863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.449006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.481511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78904a0-fe9c-44ae-9fc7-1107cbb9c655 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.541238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.542138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.542429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.542712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.548305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:08.550045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:08.551735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 82/158] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:08.552540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.559988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa00b9-c3c4-4b1e-a76f-2fdb0eb4a239 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.619250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.619951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.620226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.620501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.621241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:08.621546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:08.622918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:08.636126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 77/159] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:08.641345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.701015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04519212-1581-4b4d-b48b-ed6d8e6fe578 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.754928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.756440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.756960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.757441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.761941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.775495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:08.783273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:08.785724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:08.786623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:08.788574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:08.796425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 83/160] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:08.797474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:08.811932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc108fe-e2ec-4916-b699-76316f44d182 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.869213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:08.869875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:08.870154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:08.870434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:08.973932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286f93f-643a-40cb-8dd1-31a57273473d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:08.979917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:08.981389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927e8af-ef81-4058-9890-c385c62640a1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.052984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.054217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.054732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.055210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.059108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.060851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.062882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 84/161] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:09.063887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.075111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.091881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 78/162] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:09.093193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d837a-68f6-4423-8b04-6907448cd11a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.093481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d837a-68f6-4423-8b04-6907448cd11a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.093761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928d837a-68f6-4423-8b04-6907448cd11a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.095014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 79/163] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:09.095790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d837a-68f6-4423-8b04-6907448cd11a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.175253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.200727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928d837a-68f6-4423-8b04-6907448cd11a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.236947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.237619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.237900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.238175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.241289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f4a99-9cc6-40db-ace1-3944ce1dcd10 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.305246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.305939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.306079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.306225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.306504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.307265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:09.307591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.309004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31bc8fc-882b-471b-959d-96d690ac63ed None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.312816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.314501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.323369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 85/164] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:09.324817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.325116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.325403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.361754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:09.362966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:09.420539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 80/165] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:09.424931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.493015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 86/166] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:09.493815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.518289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.530650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93226-4b81-4b38-a359-d738735f4b34 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.573271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.596898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.598439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.598862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.599822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.604293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.606216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.608977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 81/167] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:09.611765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.614757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fad7de-ebaf-4187-beff-2ab6b003a894 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.658769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.660898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.662768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.663114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] PATH_INFO: `/v3/users/dfecdb7e62f643c1b9699f84f4b27372` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.664530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] RBAC: Authorizing `identity:get_user(user_id=dfecdb7e62f643c1b9699f84f4b27372)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.667535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.669437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 87/168] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/users/dfecdb7e62f643c1b9699f84f4b27372 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:09.670479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.779454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab480fe-47a5-483f-8a0e-44f98fe74841 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.794402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d148150-e7c4-4991-8470-4e8dc44d800f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:09.806200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.824251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.825164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.828573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.828573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.838175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:09.852081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:09.853098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:09.853877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 88/169] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:09.854541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.896314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:09.897340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:09.897622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:09.897898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] PATH_INFO: `/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:09.904319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] RBAC: Authorizing `identity:get_project(project_id=f340854d7cfb46b3aec7b85f31b4e7b2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:09.905872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:09.907637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 82/170] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/projects/f340854d7cfb46b3aec7b85f31b4e7b2 => generated 312 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:09.908484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:09.966694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:09.973907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a5b2d-7d58-4f78-a873-8f52fb2a1016 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.013229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.015252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.015895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.016517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.024265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:10.024600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.026085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.053919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 89/171] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=dfc30452d78d40f6911291710cd6601e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:10.054780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.145698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7f03-cfe3-4e2a-9e17-22e95c811711 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.172990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.227390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.228110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.228400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.228680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.308273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c376ca1a-b367-4648-bb96-1abfbd1a5fc0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.340011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.342938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6136b63-c5c9-4845-a001-a942a30f4155 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.354765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.355813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.356299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.356769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.357735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:10.358239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.359859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.368527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.371916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 90/172] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:10.372769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.469887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 83/173] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:10.471259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21573a-9a24-4bca-b21d-15d5e224a756 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.471517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21573a-9a24-4bca-b21d-15d5e224a756 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.471835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21573a-9a24-4bca-b21d-15d5e224a756 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.473259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 84/174] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:10.474167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae6c-6d72-470f-bd3e-78e886541aaa None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.474554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae6c-6d72-470f-bd3e-78e886541aaa None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.474834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74ae6c-6d72-470f-bd3e-78e886541aaa None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.480170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 85/175] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:10.481236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb215-3dbb-4683-9c71-efae1c12703b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.481529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb215-3dbb-4683-9c71-efae1c12703b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.481811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb215-3dbb-4683-9c71-efae1c12703b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.486936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 86/176] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:10.486936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afb215-3dbb-4683-9c71-efae1c12703b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.500881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119bffd-048d-4ca2-941a-a55e06ce18d2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.513839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.540450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.541642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.541930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.546467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.546467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=f340854d7cfb46b3aec7b85f31b4e7b2, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:10.546467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.546467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.552849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 91/177] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=f340854d7cfb46b3aec7b85f31b4e7b2&role.id=dfc30452d78d40f6911291710cd6601e => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:10.553637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.626155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afb215-3dbb-4683-9c71-efae1c12703b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.657243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.675428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.676176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.676458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.676732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] PATH_INFO: `/v3/users/606c52ef106342ea90cee3defca6b7ff` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.678176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] RBAC: Authorizing `identity:get_user(user_id=606c52ef106342ea90cee3defca6b7ff)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.679689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efbcce5-c1f0-4359-bbe3-97c6a1132086 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.686391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 87/178] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/users/606c52ef106342ea90cee3defca6b7ff => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:10.687606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9dc6-ba64-45b2-a07a-c526c678b318 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.688193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9dc6-ba64-45b2-a07a-c526c678b318 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.688620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb9dc6-ba64-45b2-a07a-c526c678b318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.693408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d829-66dc-4159-8397-f5b45d292cc4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.706620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4bdb9dc6-ba64-45b2-a07a-c526c678b318 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:10.707945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4bdb9dc6-ba64-45b2-a07a-c526c678b318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:10.733091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.733903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.734680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.734680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.735696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:10.737159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39157051-a69f-4574-80e0-63fe6ea33f87 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:10.740123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 92/179] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:10.740123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05333d-7001-4330-beb8-485cfd46cf01 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.740396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05333d-7001-4330-beb8-485cfd46cf01 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.743592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05333d-7001-4330-beb8-485cfd46cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.759100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9a05333d-7001-4330-beb8-485cfd46cf01 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:10.760343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a05333d-7001-4330-beb8-485cfd46cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:10.791895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 88/180] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:10.793347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.793647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.793930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.808428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.810984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:10.812198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:10.841630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 93/181] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:10.842915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46f3d-b68f-4af2-8836-509713ae5183 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.843215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46f3d-b68f-4af2-8836-509713ae5183 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.843995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46f3d-b68f-4af2-8836-509713ae5183 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:10.848083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 94/182] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:10.848601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f46f3d-b68f-4af2-8836-509713ae5183 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.881740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 89/183] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:10.882379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:10.933703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:10.956456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f46f3d-b68f-4af2-8836-509713ae5183 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.986010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b0e94-7fb4-4117-8f2e-09f171a4cc62 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:10.990785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:10.991431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:10.991751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:10.992032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.019834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.020483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.020771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.021092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.021937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=dfecdb7e62f643c1b9699f84f4b27372) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:11.022248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.023707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.039626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 90/184] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/role_assignments?user.id=dfecdb7e62f643c1b9699f84f4b27372&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=806a50b089f44cb48562ccf8ff703763 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.039626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.044233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.063476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.065108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4085c-88be-41d7-8132-2ba510915f61 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.162781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae328c7-1ea0-4867-8e93-98966a0a3a74 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.179016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.183207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 95/185] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:11.188999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.189296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.195281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.206713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.207580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.208599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.208599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.211752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:11.213012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:11.221268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:11.229607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:11.230518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:11.231294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 91/186] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:11.232569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.286522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.292140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 96/187] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:11.292856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.340405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5fab3-aaed-4815-b777-780b9a654dc1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.373613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.374404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.374699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.374971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.384949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:11.392535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:11.393616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:11.394500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:11.395089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c74d9a-42b5-4fde-96b7-34ef0527f175 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.395159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 92/188] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:11.395159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.426115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.433221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.440928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.440928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.440928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.444976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:11.453166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:11.454028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 97/189] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:11.460431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.494935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93ee21-4254-49da-ae53-a28b4ef0f7bd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.515170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.529146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.530006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.530291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.530568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.531774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.533242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.534925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 93/190] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.535717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.557087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480538f-7b63-4825-b9d5-1ab0d4c10544 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.590499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.591602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.591886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.592164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.592902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:11.593210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.594584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.603251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 98/191] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.608489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.636154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.638997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79937a8b-556a-4919-a78e-fe8b7fd9cd94 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.672973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.673766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.674317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.674594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.675802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.677312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.678970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 94/192] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.679757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.709503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13febd7a-6a9f-4311-a386-de44a984aba9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.731620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.743100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.743809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.744083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.744355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.745096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:11.745401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.746771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.759747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 99/193] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.759747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.778099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c360810-a0e7-426b-a1d7-1d13e1c242d9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.812440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.813086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.813372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.813645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.814383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:11.814683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.816102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.823996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 95/194] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.828431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.856654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e9e56-8829-4603-9ebf-e378277cb105 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.859394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.891322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.892098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.892383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.892661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.893532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=606c52ef106342ea90cee3defca6b7ff) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:11.893846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.895290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:11.901124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 100/195] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/role_assignments?user.id=606c52ef106342ea90cee3defca6b7ff&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:11.901891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:11.941110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4fba2-2650-4f7f-b7f8-2428a1daf0b0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:11.965727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:11.979793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:11.980701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:11.984705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:11.984705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:11.997190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:11.998691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.000676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 96/196] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:11 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:12.001877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.029446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940aea54-7023-443f-9cf7-e01e1e9817b6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.075100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.075885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.076172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.076442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.077145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.078578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.107449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.121207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612e029-4915-42cf-a85a-c21a52fa1b0f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.154896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.155842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.156133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.156411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] PATH_INFO: `/v3/users/cc80141f2c7045cab01f9c45977ee427` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.157708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] RBAC: Authorizing `identity:get_user(user_id=cc80141f2c7045cab01f9c45977ee427)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.159171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.160901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 97/197] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/users/cc80141f2c7045cab01f9c45977ee427 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:12.161758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.168854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 101/198] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:11 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:12.169680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.279118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2c7e-7f59-4db9-8128-4eae5f8ca039 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.286641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45053355-7e71-4220-b3e0-dee6a2527430 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.291538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.320775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.321857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.322652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.322652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.323685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.325649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.326056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.326784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.327294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 98/199] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:12.327518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.327929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.328168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.359240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.405722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.407199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.453803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769b68f-620d-421a-9e1b-289cfe3cbae5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.493166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.493833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.494118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.494397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.535629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 102/200] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:12.537460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.542859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.583186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.584970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.621092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.677458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d14dc-7a32-439d-8fed-499bade8b22f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.716482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.717282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.717568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.717847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.724233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 99/201] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:12.725730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.797397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.799980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.804457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.844311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06296a25-8859-4cc0-87bc-370f803658ed None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:12.871139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:12.883351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:12.884360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:12.884643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:12.884979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:12.886376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:12.887958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:12.889868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 100/202] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:12.890441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:12.942120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 103/203] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:12.943917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:13.019955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2e6bb-ceb3-4339-973b-05a3a9511e7b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:13.063398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146fac2-428d-40bf-98e6-6fbee8703446 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:13.067140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:13.071392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:13.072596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:13.073500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:13.084260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:13.084260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:13.084260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:13.084260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 101/204] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:13.084260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:13.115050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:13.116092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:13.116684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:13.117166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:13.118294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=e71435de8e29484ca6702023e0a9c546) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:13.118828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:13.120780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:13.127491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 104/205] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:12 2022] GET /identity/v3/role_assignments?user.id=e71435de8e29484ca6702023e0a9c546&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:13.128690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:13.152163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:13.200524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e552cc-0a87-41a8-8240-3b2744e20cdc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:13.238340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:13.239232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:13.239513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:13.239889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:13.241387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:13.242953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:13.244981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 102/206] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:13 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:13.249146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d81ea3-bc36-4a45-bbe9-d4448e71929a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:13.250820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:13.289521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:13.290762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:13.291273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:13.291864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:13.293852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, scope.project.id=10e9ac13954549a2b146650679c400cf, user.id=cc80141f2c7045cab01f9c45977ee427) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:13.294435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:13.296257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5bdfc9-ab4f-45cb-be9b-0b192d551b02 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:13.304290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 105/207] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:13 2022] GET /identity/v3/role_assignments?user.id=cc80141f2c7045cab01f9c45977ee427&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:13.369292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28827763-a0b6-4d91-9e93-650cdfff3fb8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:13.401287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:13.409398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=e71435de8e29484ca6702023e0a9c546) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:13.416822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8afedf-292c-4078-bd8e-3f4926069b63 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:13.427744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 103/208] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:13 2022] GET /identity/v3/role_assignments?user.id=e71435de8e29484ca6702023e0a9c546&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=806a50b089f44cb48562ccf8ff703763 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:14.454541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4231d-1dae-4f56-a7f8-c4b7a7ea370e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.455526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4231d-1dae-4f56-a7f8-c4b7a7ea370e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.456045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4231d-1dae-4f56-a7f8-c4b7a7ea370e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.457633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 106/209] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:14.464143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33513-9034-4db7-bec9-811c1bdadd14 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.464578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33513-9034-4db7-bec9-811c1bdadd14 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.464753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33513-9034-4db7-bec9-811c1bdadd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.482620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d8d33513-9034-4db7-bec9-811c1bdadd14 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:14.483875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d8d33513-9034-4db7-bec9-811c1bdadd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:14.557674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 104/210] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:14.582474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4231d-1dae-4f56-a7f8-c4b7a7ea370e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:14.610932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562ef0-c7e4-4145-a662-782d6086a79c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.611717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562ef0-c7e4-4145-a662-782d6086a79c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.612298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f562ef0-c7e4-4145-a662-782d6086a79c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.614049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 105/211] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:14.620222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.620740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.621235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.629635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:14.640998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:14.642890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:14.709730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4231d-1dae-4f56-a7f8-c4b7a7ea370e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:14.731690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 106/212] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:14.749039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:14.750100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.750585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.751056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.752544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:14.754206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:14.756300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:14.757671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 107/213] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:14.764428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:14.814163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:14.863223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd195-23d9-4ac2-b681-a036f22577bb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:14.866353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:14.869874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a2c70-c280-4e55-b6f5-654afef76b28 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:14.900104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:14.900913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.901203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.901484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.906932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:14.907877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:14.908360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:14.908851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:14.909756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:14.911383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:14.913506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:14.921458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:14.922360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:14.923148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:14.928138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:14.929533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.016416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 108/215] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:14 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:15.046340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93abbd-fbad-4bcc-850d-35899b00d0fa None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:15.063581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:15.086754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:15.087568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.087867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.088147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.088916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:15.089231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:15.090723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:15.101196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 108/216] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:15.108736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.218606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e64c38-568a-4a3d-993f-4ffca1e9bb00 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:15.254154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:15.255536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.256073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.256550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] PATH_INFO: `/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.272064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] RBAC: Authorizing `identity:get_user(user_id=f1ec433c69c5486c9f8b1fde1cc939ec)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:15.273882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203816e-e442-44b2-bd15-ba0cbeb202bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:15.275782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 109/217] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:15.281430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.406757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9061871-17fe-4525-bbfd-766a6552199d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:15.447605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:15.447605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.447605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.447605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.466505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e8-ab24-4f78-8cc2-faa5a69ebb94 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.466994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e8-ab24-4f78-8cc2-faa5a69ebb94 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.467068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bff6e8-ab24-4f78-8cc2-faa5a69ebb94 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.468918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 110/218] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:15.475389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.475854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.476144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.496620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:15.497738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:15.498188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:15.514248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:15.524912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:15.526402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6382e20-6858-4e00-95ba-88f8420e88ee None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:15.582874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 111/219] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:15.605955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.665714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 109/220] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:15.667685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3d10-e940-4e83-860a-22b58616ab3d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.668206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3d10-e940-4e83-860a-22b58616ab3d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.668697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff3d10-e940-4e83-860a-22b58616ab3d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.670327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 110/221] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:15.675325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff3d10-e940-4e83-860a-22b58616ab3d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.742866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aeb698-95c2-4b23-9fe5-55aedab21dfa None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:15.767948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:15.783768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff3d10-e940-4e83-860a-22b58616ab3d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:15.788741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:15.789972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.790464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.790981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.807042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:15.818004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:15.818899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:15.820085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:15.820885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:15.821718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.822003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.822278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.827855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:15.827855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dac84f9-723f-4dc8-85f6-ecc3d1e2f17a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:15.827855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 111/223] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:15.828296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:15.828494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 112/223] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:15.828590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:15.828836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:15.829836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.834755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:15.847351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:15.848936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:15.937554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 112/224] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:15.938732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:15.981139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d04427-8aa3-4b90-9312-fa3c9b03047f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.015569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.020309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.021799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.022249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.031485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.031485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:16.031485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.031485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.034833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 113/225] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:16.035964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.055755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb1691-1d00-4833-aa9b-889256e61b38 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.091825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.092613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.092954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.093245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.094080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=f1ec433c69c5486c9f8b1fde1cc939ec) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:16.094392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.095944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.102159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 113/226] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:15 2022] GET /identity/v3/role_assignments?user.id=f1ec433c69c5486c9f8b1fde1cc939ec&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=dfc30452d78d40f6911291710cd6601e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:16.102960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.111963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.154804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ddbae-f7df-4ea9-87fd-9f8e636f8a67 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.196024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.197408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.197958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.198444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.211774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:16.217679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890368a0-a07d-4a9c-9886-a832ded8ef01 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:16.220998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:16.221880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:16.222667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:16.225807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 114/227] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:16.232312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.254805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.256314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.256785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.257126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.258490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.260140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.262177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 114/228] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:16.267514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.272220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.351105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29284e-61e8-4ac4-aaf2-38c2ad6d561c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.377030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86bffc1-df99-49d5-a89f-d8eb5ba43674 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.381102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.391193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.392464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.392947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.393392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.394368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:16.397602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.397602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.406537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 115/229] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:16.412919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.415114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.416152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.416560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.416949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.418293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.419962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.422156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 115/230] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:16.428166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.505880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.545472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74e796-47f4-41e1-b027-57d569ad5bf7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.557575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360e4ca-45d7-4e49-87cc-bed8603560eb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.584210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.586901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.587195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.587481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/e71435de8e29484ca6702023e0a9c546/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.591727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, user_id=e71435de8e29484ca6702023e0a9c546, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.593306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.620681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.621650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.621999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.622293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.623517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.624999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.627005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 116/231] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:16.632383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.693734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.716443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 116/232] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:16 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/e71435de8e29484ca6702023e0a9c546/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:16.758164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce046-bc36-4beb-9f70-af6f17f9d939 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.807886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.808788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.809075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.809356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.810582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.812162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f39c3-d7fa-45a2-854f-18cb3e859650 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:16.813936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:16 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:16.820630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:16.936294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5caeb-1fd8-4ce2-86b2-0929ef43c5d5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:16.973434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:16.974929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:16.975218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:16.975502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/e71435de8e29484ca6702023e0a9c546/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:16.976353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:16.983569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, user_id=e71435de8e29484ca6702023e0a9c546, role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:16.985225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f344c3-58ab-4786-87f6-ee1b51108b1c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:17.084746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 117/234] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:16 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/e71435de8e29484ca6702023e0a9c546/roles/806a50b089f44cb48562ccf8ff703763 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:17.661741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383490c-4bad-4c22-9450-cdceb8784ea7 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:17.662282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383490c-4bad-4c22-9450-cdceb8784ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:17.662575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383490c-4bad-4c22-9450-cdceb8784ea7 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:17.664272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 118/235] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:17.669680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9a08-f56f-4838-90c6-498484862979 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:17.670155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9a08-f56f-4838-90c6-498484862979 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:17.670322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427c9a08-f56f-4838-90c6-498484862979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:17.691683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-427c9a08-f56f-4838-90c6-498484862979 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:17.693482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-427c9a08-f56f-4838-90c6-498484862979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:17.733015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004fbd-214e-4ba4-9f20-3903f26181a2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:17.733317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004fbd-214e-4ba4-9f20-3903f26181a2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:17.733586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf004fbd-214e-4ba4-9f20-3903f26181a2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:17.734960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 119/236] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:17.765770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:17.765770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:17.765770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:17.783448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 118/237] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:17.808742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:17.810052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:17.844183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9a08-f56f-4838-90c6-498484862979 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:17.930694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 120/238] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:17.956960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.011916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427c9a08-f56f-4838-90c6-498484862979 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.039123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.064814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.088759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.089567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.089862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.090147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.113858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:18.131306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f3c0b-cd58-4f4f-a234-b6294dd34120 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:18.133915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:18.134945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:18.135778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 119/239] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:18.141950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.202094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.202830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.203118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.203401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.205405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:18.207588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:18.216558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 121/240] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:18.218576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.339506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0696-5f0f-48c4-bb39-2dca44cb986a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.350110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948ef43-887b-4eb0-a658-a1853332a620 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.363659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.389938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.390619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.390909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.391192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.391949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:18.393386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e507f58-f916-44ef-a157-5b951f3b4203 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:18.397573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.398249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.398535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.398816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.399573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:18.399885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:18.401264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:18.415382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 120/241] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:18.422324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.470578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.482591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 122/242] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:18 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:18.537800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cf925-ea6f-4b22-9dbb-12afa8cfea4d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.575371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.576518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.576957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.577407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] PATH_INFO: `/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.593180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7893ffaf4a4ea0b5e745fb38f8c3a9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:18.594872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:18.597190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 121/243] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:18 2022] GET /identity/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:18.602922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344657d0-5510-4e0f-9d4c-9222a2bf7a4a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.603257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344657d0-5510-4e0f-9d4c-9222a2bf7a4a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.603515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344657d0-5510-4e0f-9d4c-9222a2bf7a4a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.605050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 123/244] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:18.608601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.610725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.611069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.611363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.634030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:18.635285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:18.763641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 124/245] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:18.790960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a7132-868f-4097-aaf7-5a917bcddfa1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.793108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:18.793535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.841115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.841840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.842129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.842458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.919391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485956a-40a2-4a22-b54d-7f781dd2660d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:18.923702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:18.925444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:18.931182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:18.961729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:18.963613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:18.964009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:18.964390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:18.979286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:18.989497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:18.990860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:18.992005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 125/246] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:18.997077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.047831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 122/247] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:19.055220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.057969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.136904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c06a6-81ed-4852-9086-848c3ff9d8df None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.183276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.185026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.185322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.185608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.186363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:19.186676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.188176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462da10-a17b-4c4e-9a49-5c468a790a1d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.188304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.198059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 126/248] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:19.203727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.228512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.229397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.229690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.229976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.232362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.233852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.235640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 123/249] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:19.241371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.242405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.317104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a5990-ec1d-46da-b6d5-cf1ea70a1a57 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.327968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.355575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.356590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.356793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.356891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abdcb3c-2558-4d20-a35d-e4fae26d46d6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.357088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] PATH_INFO: `/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.359194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=f1ec433c69c5486c9f8b1fde1cc939ec)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.360701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.362673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 127/250] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:19.368404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.395103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.395745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.396107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.396617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.397472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=3d7893ffaf4a4ea0b5e745fb38f8c3a9) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:19.397795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.399272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38c1ff-6636-4592-bfd0-f2063fdcf190 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.405494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 124/251] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/role_assignments?user.id=3d7893ffaf4a4ea0b5e745fb38f8c3a9&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:19.485058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.490501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18c56e-de79-4fdd-a228-82873eb54fa0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.491409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7daef5-1116-4be6-b71f-84d6e4e853a1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.491735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7daef5-1116-4be6-b71f-84d6e4e853a1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.492028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7daef5-1116-4be6-b71f-84d6e4e853a1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.493563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 125/252] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:19.499178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.504254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.504254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.534082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:19.535581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:19.546704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.547640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.547931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.548215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.551445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.553167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.555400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 128/253] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:19.561446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.650769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 126/254] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:19.674236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c564aad-efcf-4964-87b1-9844e8ea525f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.687240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:19.719047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.720026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.720306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.720581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/f1ec433c69c5486c9f8b1fde1cc939ec/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.727530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, user_id=f1ec433c69c5486c9f8b1fde1cc939ec, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:19.729004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173fd8bd-e423-4129-b8d1-a2eaaa476c1e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:19.775943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.809207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 129/255] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:19 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/f1ec433c69c5486c9f8b1fde1cc939ec/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:19.810596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0527-4816-421f-a684-af8e84ad731b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.810890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0527-4816-421f-a684-af8e84ad731b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.811167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e0527-4816-421f-a684-af8e84ad731b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.814128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 130/256] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:19.820401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.820782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.821066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.846134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e3a0b-104d-4afd-b65b-00d22e86de09 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:19.856194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:19.857448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:19.888999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:19.889838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:19.890134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:19.890412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:19.891433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:19.910532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:19.916656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:19.917599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 127/257] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:19.925021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.053222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 131/258] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:20.082342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.126428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d37dce-ecd3-46b0-b392-f825547ba10a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.188676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:20.230636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff91d-b787-4f3d-bf34-b3da95cc55ff None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.232252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.232946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.233235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.233526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:20.234282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:20.234769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:20.236309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:20.258041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 128/259] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:20.263822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.269134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.270378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.271408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.271900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:20.282954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:20.292557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:20.293495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:20.294357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:20.297069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 132/260] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:20.303277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.336060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:20.481787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cbc41-6d43-4c58-b3eb-d99fe1369a8d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.500587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201434b-719c-4abf-a3ec-8d9181f5d680 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.582351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.583423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.583994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.584466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:20.585427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:20.585924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:20.587501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:20.600276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.601175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.604040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.604040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:20.604040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:20.604250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 133/261] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:20.604875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:20.607721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 129/262] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:20.608829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.615277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.741139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:20.779607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:20.815197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94fd73-5dcb-49cd-a662-78f4765892c3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.869717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb274c6-0287-45ad-95fe-428371e74674 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:20.871490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.873001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.874614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.875124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] PATH_INFO: `/v3/users/e71435de8e29484ca6702023e0a9c546` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:20.876635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] RBAC: Authorizing `identity:get_user(user_id=e71435de8e29484ca6702023e0a9c546)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:20.878118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:20.883615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 134/263] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/users/e71435de8e29484ca6702023e0a9c546 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:20.886485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:20.938027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:20.938695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:20.938984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:20.939270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.109727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:21.111219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:21.133053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c3a0a6-f6ef-44e2-bf05-35f3f67aaf7a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:21.198582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:21.199255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.199975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.200261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.234088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:21.250421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:21.333948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:21.335528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:21.352497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 130/264] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:21.359048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:21.497456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 135/265] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:21.502753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:21.569734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:21.629790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681208f-7bea-4b5d-8db2-bd420e80d5f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:21.632019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30cc7a-ca29-47e3-bde3-fab1bd39aa85 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:21.667827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:21.669067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.669547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.670143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.671572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:21.673262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:21.675483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 136/266] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:21 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:21.681941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:21.714672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:21.715937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.717449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.717920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.720775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:21.722413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:21.729536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 131/267] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:21 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:21.732492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:21.781414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:21.884324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87da21-95e7-4808-b071-c10adea866c1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:21.914846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:21.928366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815134a9-c108-4dcc-8270-10953b85edbb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:21.946290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:21.947255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.947742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.948298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.949332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=e71435de8e29484ca6702023e0a9c546) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:21.949983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:21.951690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c546a-efa9-4ad3-83d3-37f11d04bf69 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:21.959522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 137/268] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:21 2022] GET /identity/v3/role_assignments?user.id=e71435de8e29484ca6702023e0a9c546&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=806a50b089f44cb48562ccf8ff703763 => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:21.961199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e59e1-96e8-43d0-861d-1b67549682de None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.961827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e59e1-96e8-43d0-861d-1b67549682de None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.962302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e59e1-96e8-43d0-861d-1b67549682de None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:21.964933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 138/269] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:21.972661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:21.973228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:21.973675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.008488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:22.010607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.011533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.012211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.013365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.014449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=e71435de8e29484ca6702023e0a9c546) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:22.015215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:22.016032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:22.017551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b984a22-a57d-4491-abb1-0a27435058ab None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:22.025314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 132/270] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:21 2022] GET /identity/v3/role_assignments?user.id=e71435de8e29484ca6702023e0a9c546&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:22.121264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4565-a96c-4cb0-b1ce-5e9e80d81203 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.121728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4565-a96c-4cb0-b1ce-5e9e80d81203 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.122113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a4565-a96c-4cb0-b1ce-5e9e80d81203 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.124054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 133/271] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:22.130615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.131106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.131400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.131824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 139/272] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:22.150252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:22.151392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:22.181096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.231805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 134/273] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:22.256729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.276661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:22.360966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e472f-3434-474f-9b96-7f36ccc55c96 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.372552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:22.375177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee1ddc-1e73-4a8f-91bc-8a3bfc789d90 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.410754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.411529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.411862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.412149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.430838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.431712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.431996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.432269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.433088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:22.433439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:22.434894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856e889-09eb-43d4-b051-f8636c85f6b0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:22.437173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 135/274] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:22.438344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c4b2c-8e3a-4b77-be42-1423e9db6815 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.438628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c4b2c-8e3a-4b77-be42-1423e9db6815 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.438903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c4b2c-8e3a-4b77-be42-1423e9db6815 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.440295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 136/275] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:22.443765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:22.444988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:22.446023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 140/276] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:22.446986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.446986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.446986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.450590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.469938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:22.471126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:22.545452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 137/277] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:22.546710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.562877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:22.568708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281f63f-2cf5-4049-98f2-3224725b94da None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.605275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.605947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.606234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.606515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.607232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:22.608714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:22.655100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e382cc-cea3-41a7-a5b9-09f2670afd2c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.690405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.691000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.691282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.691591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.692318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:22.692644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:22.694330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:22.702461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 138/278] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:22.703238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.723582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 141/279] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:22 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:22.723582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.753102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:22.814518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:22.846892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2898a8-e718-4fe9-85b9-c451bfd437fe None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.852770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbf243-1ae7-4208-a392-2bec4f8a0592 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:22.897738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.897941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:22.898541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.898784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:22.898901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.899080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:22.899174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.899363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] PATH_INFO: `/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:22.900635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7893ffaf4a4ea0b5e745fb38f8c3a9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:22.902664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:22.905014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 142/280] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:22.912214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:22.917235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:22.925438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:22.926324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:22.927907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 139/281] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:22.935882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.038101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cd4eb-5e49-4385-94f2-0f45506d36f4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.040024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:23.078901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a0411-eab2-4753-9a0c-868843d0f8bb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.087342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.087342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.087896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.088249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.090124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.092191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.094651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 143/282] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:23.102660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.129709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.130499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.130784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.131059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.131852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:23.132163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.133559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50dedc4-c828-4487-a5a9-5798d9752ac5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.136671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:23.146124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 140/283] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:23.147477 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae15-e209-4a61-add7-8c3dd856c530 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.147965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae15-e209-4a61-add7-8c3dd856c530 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.148250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae15-e209-4a61-add7-8c3dd856c530 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.149848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 141/284] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:23.154451 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffae15-e209-4a61-add7-8c3dd856c530 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.215927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402930a3-9636-4f69-b5d7-88c1d93a9236 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.252948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.253847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.254229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.254575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9/roles/ea4e76d231a34b46a40fbc85c2746da3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.256811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, user_id=3d7893ffaf4a4ea0b5e745fb38f8c3a9, role_id=ea4e76d231a34b46a40fbc85c2746da3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.258502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.271333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffae15-e209-4a61-add7-8c3dd856c530 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.307314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.308147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.308457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.308710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] PATH_INFO: `/v3/users/38b35ed7efef449aba8b974683fbb596` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.323253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] RBAC: Authorizing `identity:get_user(user_id=38b35ed7efef449aba8b974683fbb596)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.324737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc1a04-52af-4209-8e66-091f6a49de84 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.326455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 142/285] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:23 2022] GET /identity/v3/users/38b35ed7efef449aba8b974683fbb596 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:23.327697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.327969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.328245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.335736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 144/286] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:50:23 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9/roles/ea4e76d231a34b46a40fbc85c2746da3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:23.337072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.346247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:23.352862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:23.383597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:23.406554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:23.424588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 143/287] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:23.448326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.493848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d89890-7664-4095-9ec4-e8f507b3140c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.566140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.567278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.567993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.568561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.569618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, user.id=38b35ed7efef449aba8b974683fbb596, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:23.570287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.572083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.582525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 145/288] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jul 25 05:50:23 2022] GET /identity/v3/role_assignments?user.id=38b35ed7efef449aba8b974683fbb596&scope.system=all&role.id=dfc30452d78d40f6911291710cd6601e => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:23.590428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0cc20f-0b75-42af-8c57-b2bf645e3ac6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.633129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.634383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.634924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.635405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.648121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:23.656959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:23.657933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:23.658709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:23.662601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 144/289] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:23.668067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.771584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:23.791622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c4334-4f51-41d2-8c39-eb4c28969d3d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:23.846172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:23.847195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:23.847720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:23.848205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:23.849724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:23.850235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:23.851892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:23.861960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 146/290] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:23.867830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:23.927721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:24.013906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cbd69-65ca-4420-9e4e-7126de6917d8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:24.060641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:24.062007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:24.062513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:24.062990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] PATH_INFO: `/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:24.064453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] RBAC: Authorizing `identity:get_user(user_id=f1ec433c69c5486c9f8b1fde1cc939ec)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:24.066094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:24.068104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 145/291] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:23 2022] GET /identity/v3/users/f1ec433c69c5486c9f8b1fde1cc939ec => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:24.076910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:24.214474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b47203-9eb0-400e-a70f-3f5224383b54 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:24.260067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:24.261123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:24.261615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:24.262254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:24.287944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:24.362982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:24.364510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:24.492578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 147/292] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:24.497970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:24.642660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523f36-c893-402a-a89c-df8f75067beb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:24.658174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:24.680137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:24.681363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:24.681855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:24.682334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:24.683760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:24.685502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab48931-1e8b-4945-80b0-66b302809f04 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:24.687799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 146/293] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:24 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:24.695616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:24.780622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:24.847342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791039cf-7bec-4f0b-949d-d996eae8dbf5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:24.894092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:24.894752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:24.895036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:24.895312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:24.896925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=f1ec433c69c5486c9f8b1fde1cc939ec) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:24.897234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:24.898666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db042c22-9c8c-423c-a45d-085146b8490a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:24.908253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 148/294] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:24 2022] GET /identity/v3/role_assignments?user.id=f1ec433c69c5486c9f8b1fde1cc939ec&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=dfc30452d78d40f6911291710cd6601e => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:25.424600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db988-6e4d-494f-a361-e228d6ecc1dc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.425593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db988-6e4d-494f-a361-e228d6ecc1dc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.426085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093db988-6e4d-494f-a361-e228d6ecc1dc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.428538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 147/295] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:25.434128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a4d-e679-4cd6-ac9a-561ea2488124 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.434560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a4d-e679-4cd6-ac9a-561ea2488124 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.434735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c3a4d-e679-4cd6-ac9a-561ea2488124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.455998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8b1c3a4d-e679-4cd6-ac9a-561ea2488124 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:25.457192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8b1c3a4d-e679-4cd6-ac9a-561ea2488124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:25.537574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 149/296] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:25.561997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db988-6e4d-494f-a361-e228d6ecc1dc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:25.666209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098616d3-c592-4e7b-bbd9-ba5dca43f73f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.666849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098616d3-c592-4e7b-bbd9-ba5dca43f73f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.667336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098616d3-c592-4e7b-bbd9-ba5dca43f73f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.668969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 150/297] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:25.674430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.675097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.675276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093db988-6e4d-494f-a361-e228d6ecc1dc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:25.675789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.694124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:25.695714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:25.711409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:25.712247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.712531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.712805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.726579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:25.735801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:25.736060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:25.736921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:25.737713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:25.740956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 148/298] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:25.748225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:25.783506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 151/299] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:25.798059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:25.802496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:25.871330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ed9c7-9a1c-4d64-a866-71e34ab23c5f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:25.908416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:25.909080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.909360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.909630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.910137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef096b4f-72ec-4584-bd5b-8368298b2694 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:25.910362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:25.910660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:25.912971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d72aeb1-c391-4a85-b04e-3873fb3fac3e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:25.921446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 149/300] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:25.928155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335444-5e24-49bc-80ee-f434ef33a8ee None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.928392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335444-5e24-49bc-80ee-f434ef33a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.928662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8335444-5e24-49bc-80ee-f434ef33a8ee None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.931701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 150/301] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:25.931701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8335444-5e24-49bc-80ee-f434ef33a8ee None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:25.949028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:25.949835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.950121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.950407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.951603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:25.953200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f5281-e28c-4fa3-8d48-a76f9531c55b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:25.954969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 152/302] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:25.956955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:25.957249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:25.957534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:25.978384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:25.979607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:26.013750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.051374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8335444-5e24-49bc-80ee-f434ef33a8ee None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.056201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.067582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 153/303] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:26.067582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.104393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.105267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.105564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.105910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] PATH_INFO: `/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.121467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3ddc01af944c2b811fcc9f5e489fd1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.122917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.124802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 151/304] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:25 2022] GET /identity/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:26.130151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.162925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22b1be-4608-49f5-90fd-81147a8e69d6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.196774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.197366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.197648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.197925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] PATH_INFO: `/v3/groups` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.198620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.200089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.228932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc2c3f-b174-419a-919a-b7e6b2c80f36 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.251272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 154/305] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Jul 25 05:50:26 2022] POST /identity/v3/groups => generated 229 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:26.252147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.268952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.269791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.270058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.270336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.283072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:26.285173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-76846a8d-0878-4570-9c6e-97b24a827b12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:26.291948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:26.292907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:26.294191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 152/306] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:26.295089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2f79-96e8-467c-a431-6df8399c3f75 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.295160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2f79-96e8-467c-a431-6df8399c3f75 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.295417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca2f79-96e8-467c-a431-6df8399c3f75 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.296914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 153/307] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:26.302311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca2f79-96e8-467c-a431-6df8399c3f75 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.329464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.377084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3664c2-c236-4467-9e6d-a9a8bd44cbe0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.419484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca2f79-96e8-467c-a431-6df8399c3f75 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.420628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.421302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.421727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.422018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.422860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, user.id=1d3ddc01af944c2b811fcc9f5e489fd1, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:26.423179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.425007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bfa6b2-8604-4ac4-a68d-6270c168efc2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.432878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 155/308] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/role_assignments?user.id=1d3ddc01af944c2b811fcc9f5e489fd1&scope.system=all&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:26.434025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.434323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.434846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.455670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:26.458722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:26.474987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.476354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.477591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.477824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.478545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:26.478854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.480290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.490546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 154/309] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:26.496540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.545468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 156/310] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:26.567856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.596479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.604633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.631269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2058c-f9f3-4f65-9057-811cb19f6fe8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.676597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.678326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.678826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.679620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] PATH_INFO: `/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.681326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] RBAC: Authorizing `identity:get_user(user_id=3d7893ffaf4a4ea0b5e745fb38f8c3a9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.683677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.690827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 155/311] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/users/3d7893ffaf4a4ea0b5e745fb38f8c3a9 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:26.692934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.695443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde7e15-029a-40ff-abaf-75255d8d2056 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.738653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.740445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.740876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.741298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.752979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:26.762487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:26.763414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:26.764230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:26.767307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 157/312] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:26.773137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:26.804075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456a9ba-3d69-465b-b81f-e13204a1d2b2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.847130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.848888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.849382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.849860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.872868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.892385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8047c780-5481-490f-8249-d7d7dbfc710d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:26.892574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:26.929622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:26.930186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.930295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:26.930564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:26.930842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:26.931622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:26.931935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:26.932728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.933288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:26.947807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 158/313] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:26.950593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.049819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 156/314] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:27.056591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.089462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c410e-0f7f-4ab4-9b03-445c6c96d664 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.114326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:27.131455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.132384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.132664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.132940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] PATH_INFO: `/v3/users/38b35ed7efef449aba8b974683fbb596` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.135010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] RBAC: Authorizing `identity:get_user(user_id=38b35ed7efef449aba8b974683fbb596)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.136501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.142884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 159/315] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:26 2022] GET /identity/v3/users/38b35ed7efef449aba8b974683fbb596 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:27.144455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.165581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:27.172536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad414d-dbe5-483b-a352-b3ccdee313de None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.211104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.212513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.213048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.213518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.215041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.216830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.224430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 157/316] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:27.226109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:27.267293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fd867-962b-4255-964d-e6f809b198bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.315274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.316740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.318326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.318874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] PATH_INFO: `/v3/system/users/38b35ed7efef449aba8b974683fbb596/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.321098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38b35ed7efef449aba8b974683fbb596, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.323032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc63745b-ae71-4558-915f-da5f28ad3f7f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.337013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59899145-a873-4f29-9821-9be2863445f6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:27.358517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:27.373043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:27.373696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:27.373980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:27.374256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:27.375082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, scope.project.id=771d014e7c874f49b7d1871a58a042b9, user.id=3d7893ffaf4a4ea0b5e745fb38f8c3a9) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:27.375393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:27.376947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f93b95-ac5b-4439-8e1f-ddbd287af062 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:27.382704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 158/317] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:27 2022] GET /identity/v3/role_assignments?user.id=3d7893ffaf4a4ea0b5e745fb38f8c3a9&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:27.419824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 160/318] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Jul 25 05:50:27 2022] PUT /identity/v3/system/users/38b35ed7efef449aba8b974683fbb596/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:28.430414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5265c2-8d1d-4678-98d4-70ff61879fdc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.430900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5265c2-8d1d-4678-98d4-70ff61879fdc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.430900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5265c2-8d1d-4678-98d4-70ff61879fdc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.432463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 159/319] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:28.437543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.437917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.438113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.455509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:28.456750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:28.512581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778273-314f-4a0d-b11a-cd4debb7a78e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.512877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778273-314f-4a0d-b11a-cd4debb7a78e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.513173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24778273-314f-4a0d-b11a-cd4debb7a78e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.514557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 160/320] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:28.519659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.519952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.521066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.528878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 161/321] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:28.541622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:28.542826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:28.553278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.563175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:28.616150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 161/322] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:28.638608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.662276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752d22d-4273-4b8e-9c60-543f5d760c49 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.698264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.699362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.699877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.700230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.701387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.702892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.709737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 162/323] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:28.710973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.747435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006e99-98d0-4687-bf03-37e90c295863 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.761616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:28.781495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.782366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.782651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.782943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.791582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:28.794145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:28.802735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:28.804801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:28.805788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 162/324] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:28.809723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.821707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64127b62-10d5-4267-b2b5-11fd9dd918f9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.860784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.861456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.861745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.862026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] PATH_INFO: `/v3/groups` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.862719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.864218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.914855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aa831-4687-4a3c-a0d3-e8cc46448d8e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:28.948079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:28.948791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:28.949020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:28.949291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:28.950022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:28.950322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:28.951733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:28.960670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 163/325] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:28.965737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:28.978679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 163/326] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Jul 25 05:50:28 2022] POST /identity/v3/groups => generated 226 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:50:29.008221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:29.089888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780b326-060c-4b1d-ac7f-6593122bff9c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.129987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.131486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.131620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.131853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] PATH_INFO: `/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.133385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3ddc01af944c2b811fcc9f5e489fd1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.134545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867d44-5c7c-4ad1-b90b-5329934488a6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.136211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 164/327] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:28 2022] GET /identity/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:29.141804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.250086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09408a-9450-4f03-93f6-ee279c4f7596 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.285779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.287272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.287570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.287865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] PATH_INFO: `/v3/system/users/1d3ddc01af944c2b811fcc9f5e489fd1/roles/ea4e76d231a34b46a40fbc85c2746da3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.289394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1d3ddc01af944c2b811fcc9f5e489fd1, role_id=ea4e76d231a34b46a40fbc85c2746da3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:29.290783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26066e3f-d2b5-466c-80f5-fa35c47daf35 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:29.292505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:29.391382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 164/328] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Jul 25 05:50:29 2022] PUT /identity/v3/system/users/1d3ddc01af944c2b811fcc9f5e489fd1/roles/ea4e76d231a34b46a40fbc85c2746da3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:29.498685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703877ba-45ae-44c6-8d08-ed504ab2a78a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.499196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703877ba-45ae-44c6-8d08-ed504ab2a78a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.499270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703877ba-45ae-44c6-8d08-ed504ab2a78a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.501093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 165/329] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:29.506921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.507424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.507499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.529507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:29.530741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:29.611235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 165/330] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:29.636575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703877ba-45ae-44c6-8d08-ed504ab2a78a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.768304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703877ba-45ae-44c6-8d08-ed504ab2a78a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:29.770908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:29.812245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:29.813048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:29.813330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:29.813603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:29.827580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:29.835999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:29.836880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:29.837663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:29.844305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:29.989652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54a583-ae69-4354-bd42-4ceed29e4a60 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.026166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:30.034338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.035029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.035317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.035630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.037026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:30.037713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.039172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.054069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:30.059770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:30.193839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c2f53-8bf9-418d-b9a8-a04fedab9b42 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.237818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.239051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.240115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.240592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] PATH_INFO: `/v3/users/38b35ed7efef449aba8b974683fbb596` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.242026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] RBAC: Authorizing `identity:get_user(user_id=38b35ed7efef449aba8b974683fbb596)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.243792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21e2a-7999-4729-a733-4ed22866702e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.245951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:30 2022] GET /identity/v3/users/38b35ed7efef449aba8b974683fbb596 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:30.251895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:30.395334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a344d61b-6a6e-48b5-b9dd-c7a6686092c5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:30.438564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:30.439236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:30.439522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:30.439852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:30.440679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] RBAC: Adding query filter params (role.id=dfc30452d78d40f6911291710cd6601e, user.id=38b35ed7efef449aba8b974683fbb596, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:30.440997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:30.443060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a667b-ddff-4dbb-915f-35c5ade27efd None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:30.463039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 167/334] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jul 25 05:50:30 2022] GET /identity/v3/role_assignments?user.id=38b35ed7efef449aba8b974683fbb596&scope.system=all&role.id=dfc30452d78d40f6911291710cd6601e => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:31.530250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5a40-cdbb-4def-99f2-49c7f0bb7452 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.530757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5a40-cdbb-4def-99f2-49c7f0bb7452 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.530861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5a40-cdbb-4def-99f2-49c7f0bb7452 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.532442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 168/335] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:31.539826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.540704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.541186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.562064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:31.563612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:31.626749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:31.651283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:31.687912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5a40-cdbb-4def-99f2-49c7f0bb7452 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:31.730448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:31.816443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5a40-cdbb-4def-99f2-49c7f0bb7452 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:31.869127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:31.869936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:31.870222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:31.870502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:31.885831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:31.900571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:31.901485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:31.902257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 169/337] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:31.908178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.026441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32570d2-a81f-4bbc-a1f8-0fa27436924e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.081530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.082128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.082416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.082699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.083484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:32.083825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.085203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263c1ad-c16f-4d24-ad6c-41fe2eb9d23f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.097871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 169/338] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:32.104086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.215712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.225065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffebc2-0907-49be-9002-0bed3e794efb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.261949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.262823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.263295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.263598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.335433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.338776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.432682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.441729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3073f9-5024-4150-a025-7b11255c80d4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.442026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3073f9-5024-4150-a025-7b11255c80d4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.442389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3073f9-5024-4150-a025-7b11255c80d4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.444113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 170/339] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:32.445598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 170/340] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:32.450969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.451291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.451800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.452090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.475612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:32.476965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:32.518858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.567039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 171/341] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:32.595389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.615970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d120b-ab34-4f3d-bcb3-0c96786a531a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.680597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.682048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.682565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.683041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.684587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.686373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.688473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 171/342] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:32.696665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.789799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:32.823477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6ff8-3412-40c4-811b-8edf24d26bbd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.861323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b1694-f3f7-4df7-805a-4124de81d231 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:32.902827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.905075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.905369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.905662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.917321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:32.918135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.918414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.918688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.922103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:32.923875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469a83e-9760-4fea-b7d4-75a8bd7316cd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:32.925632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 172/343] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:32.927140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a02a-2ea8-4b76-953d-a38d8fbf7581 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.932870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a02a-2ea8-4b76-953d-a38d8fbf7581 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.936725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a02a-2ea8-4b76-953d-a38d8fbf7581 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:32.938262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 173/344] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:32 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:32.941740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44a02a-2ea8-4b76-953d-a38d8fbf7581 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:32.949947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-464345f7-ba31-422a-b271-9bd354140872 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:32.957807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:32.958722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 05:50:32.959530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:32.963785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 172/345] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:32.965926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:32.966227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:32.966509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.002349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:33.003604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:33.055084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.108251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 173/346] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:33.108846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.123924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44a02a-2ea8-4b76-953d-a38d8fbf7581 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.165943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.182532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.183798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.184662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.185266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.186398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=10e9ac13954549a2b146650679c400cf) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:33.186915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:33.189041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62076f9a-9bcb-4ec5-bcfd-f64a2424f3ad None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:33.197112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 174/347] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:32 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=dfc30452d78d40f6911291710cd6601e => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:33.199076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa60af-9f06-45c3-ba77-f0dfb776465b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.199369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa60af-9f06-45c3-ba77-f0dfb776465b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.199673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa60af-9f06-45c3-ba77-f0dfb776465b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.202152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 175/348] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:33.203203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa60af-9f06-45c3-ba77-f0dfb776465b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.265697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b69fe7-2d89-4254-bb3d-64b76c1116ae None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.318356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.319047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.319332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.319832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.320603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] RBAC: Adding query filter params (name=reader) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:33.320912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:33.322560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd59fe2c-063c-44db-a4e4-2832213ac6ee None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:33.333502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 174/349] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:33.334987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125f82-d856-42e6-bd84-9c403ace19b3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.335279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125f82-d856-42e6-bd84-9c403ace19b3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.339809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125f82-d856-42e6-bd84-9c403ace19b3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.341659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 175/350] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:33.343081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2df726-f0f6-4673-8b1e-125fce19b231 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.343435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2df726-f0f6-4673-8b1e-125fce19b231 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.343742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2df726-f0f6-4673-8b1e-125fce19b231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.362996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa60af-9f06-45c3-ba77-f0dfb776465b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.365736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4c2df726-f0f6-4673-8b1e-125fce19b231 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:33.367127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4c2df726-f0f6-4673-8b1e-125fce19b231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:33.394535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.424643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.425474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.425764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.426057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.438226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:33.447249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:33.448875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 176/351] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:33.449682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.467850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 176/352] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:33.470228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.470700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.471155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.498465 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:33.500285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:33.511919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.581087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612fe10c-2792-4675-b45a-a97d01908c8c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.607472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 177/353] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:33.608526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.641771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.642862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.643326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.650327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] PATH_INFO: `/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.650327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] RBAC: Authorizing `identity:get_user(user_id=1d3ddc01af944c2b811fcc9f5e489fd1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:33.650327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:33.653891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 177/354] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/users/1d3ddc01af944c2b811fcc9f5e489fd1 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:33.654809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.742365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.765408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1e0f6-092b-4170-ad67-2040b1c9e13b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.810072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6bcb6-7a56-4f73-8297-31a9e2223986 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:33.814970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.815688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.815982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.816267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.817037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:33.817391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:33.818813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:33.831358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 178/355] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:33.832337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.857484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:33.871300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:33.873811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:33.873811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:33.873811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:33.895203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:33.913551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:33.914486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:33.915286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:33.919242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 178/356] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:33.919242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:33.995109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530b32-ce8b-450f-8a10-37cf05d134e4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.046580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.046580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.046580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.046580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.047504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] RBAC: Adding query filter params (role.id=ea4e76d231a34b46a40fbc85c2746da3, user.id=1d3ddc01af944c2b811fcc9f5e489fd1, scope.system=all) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:34.047504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.055020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.063769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 179/357] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/role_assignments?user.id=1d3ddc01af944c2b811fcc9f5e489fd1&scope.system=all&role.id=ea4e76d231a34b46a40fbc85c2746da3 => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:34.064556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.067488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.074641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908e44e-2775-47bc-b29b-89e8e6f76a3f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.127656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.127656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.128095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.128465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.156526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:34.166566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:34.167603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:34.168433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 179/358] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:34.170012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.212314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea8c5c-75f6-4195-92f5-817fc2a822eb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.228308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.256444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.257116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.257401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.257683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.311620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69039e4-acf9-4c11-90f1-aa258fa51fa0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.349658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.351115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.354491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.357425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.358103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.358388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.358662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.359412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:34.359747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.361111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ace250-903a-4ada-9292-96d5c5ce57fb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.374000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 180/359] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:34.375335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d52c6-408b-4f88-9c99-928aff9bf204 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.375653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d52c6-408b-4f88-9c99-928aff9bf204 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.375934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d52c6-408b-4f88-9c99-928aff9bf204 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.377288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 181/360] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:34.377843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d52c6-408b-4f88-9c99-928aff9bf204 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.493735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 180/361] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:34.494795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.503391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.510893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d52c6-408b-4f88-9c99-928aff9bf204 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.552285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.552983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.553323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.553535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.554315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:34.554618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.556103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea00bb5-63f4-4f60-bc64-258b4293758a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.568135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 182/362] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:34.569463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.569784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.570038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.591581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:34.593217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:34.627098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654422d-5c5c-41d5-a1da-e0aa15124824 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.629255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.676370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.678047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 183/363] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:34.678941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.679627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.679940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.680228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.766876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.768576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.794125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.809526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094383b-aca1-4859-a252-ee8064f09463 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:34.860317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:34.861189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:34.861471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:34.861748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:34.863669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:34.865742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:34.867699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 184/364] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:34.868390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.902081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 181/365] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:34.902934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:34.905514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:34.998900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f062e62-4c2e-4ebc-bbef-585a6fe1e698 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.118921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f693de7-ecb2-4710-b0bf-f472d4608514 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.119129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.119129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.119129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.119129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.119454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.119454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.119454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.119454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.119753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:35.119830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:35.120576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:35.121509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 182/366] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:35.122296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.134843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.136060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.185806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.238542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656a0ff-779d-409e-968e-aa2cce704798 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.259983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 185/367] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:35.260848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.281541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.282410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.282695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.282975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.284803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.287877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.289854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 183/368] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.290861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.335318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.378209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b846e7-839a-4407-a27d-b03254098a09 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.422310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.422534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8bb9e-f128-48d0-91d5-88ce9e64f443 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.423185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.423801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.424081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.428739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.430205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.431971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 186/369] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.433285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.461413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.470004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.475775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.485077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 184/370] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.486231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.568233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2829cd-642e-4279-a4ff-3e9d05056734 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.600203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.611276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.613117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.613117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.613117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.614240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.615755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.619729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 187/371] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.619729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.624844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a5e11-ee0c-46c5-af47-a1b850a2a416 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.666243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.666869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.667145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.667388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.668262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=10e9ac13954549a2b146650679c400cf) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:35.668581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.670025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.676797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 185/372] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=806a50b089f44cb48562ccf8ff703763 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.677613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.749257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.759512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8ee4c-81ba-4cee-b399-2361fecf1bf2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.810213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc12c9e-9086-4a3c-85e7-3390dbe97c9b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:35.824408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.825413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.825699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.825978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.827911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.829369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91336e-7519-482b-b5d6-ddccfd11949d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.831268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 188/373] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:35.833683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ff562-5baf-4a1c-9780-a7f59cd711a7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.834155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ff562-5baf-4a1c-9780-a7f59cd711a7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.834441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ff562-5baf-4a1c-9780-a7f59cd711a7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.839991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 189/374] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:35.840911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ff562-5baf-4a1c-9780-a7f59cd711a7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:35.860740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:35.862219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:35.862219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:35.862219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:35.934189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:35.951146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:35.953751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940f54d-17ac-4fc2-8029-2866f2ffada6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:35.990065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ff562-5baf-4a1c-9780-a7f59cd711a7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.021954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.050357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.051236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.052277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.052570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.053818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.055234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.057278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 190/375] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:36.057991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.095191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 186/376] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:36.096423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.096423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.096423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.115964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:36.117182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:36.190029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4390a05-c153-434f-87fb-cb551df28353 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.212436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 187/377] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:36.213309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.234004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.234777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.235066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.235346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.236370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=771d014e7c874f49b7d1871a58a042b9) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:36.236682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.239328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.241449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.245500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 191/378] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=dfc30452d78d40f6911291710cd6601e => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:36.246349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.337132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.358755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba40220-bb6a-4659-81c9-dace6c666121 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.389269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14c135-356b-43bc-9a8a-1b810e0e26d7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.418568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.419463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.419910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.420288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.421222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=771d014e7c874f49b7d1871a58a042b9) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:36.421638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.423405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.430759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 188/379] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=806a50b089f44cb48562ccf8ff703763 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:36.436514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.437721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.438800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.439254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.439781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] PATH_INFO: `/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.441273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] RBAC: Authorizing `identity:get_project(project_id=1ff9f2a23bd646d2af236b8a1efad9a1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.444013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.446086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 192/380] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:36.451818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.577142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.621360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d643c-9350-4ef7-a473-d660a6ad5b49 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.638258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768ffe6-b25e-4fb1-9985-804db27d6664 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.668342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.669229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.669510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.669785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] PATH_INFO: `/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.675482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] RBAC: Authorizing `identity:get_group(group_id=9a0d124ea8bf4a2eaadd1bb212b3250a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.677450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.679433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 193/381] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:36.685763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.719391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.720178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.720509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.720786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.742990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:36.756358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:36.757264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:36.758074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:36.759162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 189/382] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:36.765772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:36.797490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.827498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed6015-89b5-468c-a6c4-56520c4b839b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:36.859074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:36.869869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] RBAC: Adding query filter params (group.id=9a0d124ea8bf4a2eaadd1bb212b3250a, role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=1ff9f2a23bd646d2af236b8a1efad9a1) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:36.878080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:36.882625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 194/383] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/role_assignments?group.id=9a0d124ea8bf4a2eaadd1bb212b3250a&scope.project.id=1ff9f2a23bd646d2af236b8a1efad9a1&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:36.986874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7623-de9e-41e4-87eb-76673da46a77 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.035166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.036923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.037411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.037908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.038871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:37.039376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.041015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.055958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 190/384] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:37.061557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.202297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa2546e-a02c-4934-b184-6c98280d9327 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.245357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.246140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.246420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.246692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.247886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.249307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.251239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 195/385] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:37 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:37.257063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.372653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:37.408162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83de29-0be7-47ba-a403-6ae236956266 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.457361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.458742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.459070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.459351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.464275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.465744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706afb2-8e3c-4e51-b307-d35047fd0309 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.467771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 191/386] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:37 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:37.473183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:37.569549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:37.627846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d8536-1f84-4d29-8714-6e301d33beb1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:37.667018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:37.667936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:37.668223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:37.668506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/groups/9219e86037d34536a79034d8b1904346/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:37.672814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, group_id=9219e86037d34536a79034d8b1904346, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:37.674518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49530f39-ece4-43d3-86d2-8ca41d885eb6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:37.750699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 196/387] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jul 25 05:50:37 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/groups/9219e86037d34536a79034d8b1904346/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:38.239457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4bb2-8bf4-4860-8a44-33686cdfd44c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.240081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4bb2-8bf4-4860-8a44-33686cdfd44c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.240081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4bb2-8bf4-4860-8a44-33686cdfd44c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.241745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 192/388] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:38.246776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.247187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.247355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.267733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.269266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.369038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 197/389] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:38.401439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4bb2-8bf4-4860-8a44-33686cdfd44c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.544809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4bb2-8bf4-4860-8a44-33686cdfd44c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.590159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.590985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.591272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.591567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.602986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:38.606496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-477ef3e2-1bf8-4497-8e1c-e4dcd02d53ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:38.621848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:38.622703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:38.623497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 193/390] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:38.624197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.722347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:38.724245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61180c-c648-4ba7-a5b1-ecd424093aef None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.724835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61180c-c648-4ba7-a5b1-ecd424093aef None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.725333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61180c-c648-4ba7-a5b1-ecd424093aef None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.726912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 194/391] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:38.732352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.732889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.733389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.762202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:38.763404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:38.796653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6fe963-896f-4a19-8bdb-dbe48cdf245b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:38.833629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:38.834315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:38.834597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:38.834871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:38.835643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:38.835947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:38.837317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:38.846216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 198/392] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:38.852588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:38.881765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 195/393] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:38.925293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.001357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54eb0ef-adca-42a0-8c65-a68c271cca48 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.014009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.040855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.042132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.042589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.043007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.044589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.046275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fd6b0-2ec1-45cb-aff2-1ff5154c3344 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.048044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1061f-5251-4219-8913-17b0230f2ebd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.049373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 199/394] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.052000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c0c-38cc-4f54-b672-70e83f7d89d1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.052529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c0c-38cc-4f54-b672-70e83f7d89d1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.053016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b8c0c-38cc-4f54-b672-70e83f7d89d1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.054865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 200/395] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:39.059827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8c0c-38cc-4f54-b672-70e83f7d89d1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.078601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.085189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.089649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.089649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.089649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.097916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-10f4a534-a44a-4e02-8d3b-bb605f393128 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:39.107350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:39.108254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:39.109140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 196/396] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:39.110211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.110500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.110780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.128540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:39.129748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:39.185379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b8c0c-38cc-4f54-b672-70e83f7d89d1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.204969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 197/397] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:39.205897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.225737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.227114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.227598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.228079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.232441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.234126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.236289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 201/398] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.237123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.294076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.351876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9569-e5e3-47e8-a8fa-6afe193b3c78 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.357457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad35849-e349-4be7-bddc-b2855f721f9f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.376126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.391587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.392602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.393108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.393594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.394534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:39.395088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.396952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.402167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.403425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.403730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.404011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.408712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 198/399] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.409785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.418480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:39.430298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:39.431193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:39.432027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 202/400] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:39.432681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.542549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1928fc0e-43ce-4622-8c58-caaf450ecd7c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.556992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6ba7a-2131-4788-96c0-4d1e7c1361f3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.564070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.587280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.597297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.597297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.597297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf/groups/9219e86037d34536a79034d8b1904346/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.597533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.597630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] RBAC: Authorizing `identity:create_grant(project_id=10e9ac13954549a2b146650679c400cf, group_id=9219e86037d34536a79034d8b1904346, role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.597713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.597713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.597713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.597884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395feae1-c163-47fe-beb9-44b424667a79 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.597958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.597958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.597958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 203/401] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.597958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.703199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808381e2-5ada-4630-8c76-81fcf20202f2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 199/402] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jul 25 05:50:39 2022] PUT /identity/v3/projects/10e9ac13954549a2b146650679c400cf/groups/9219e86037d34536a79034d8b1904346/roles/806a50b089f44cb48562ccf8ff703763 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb713-3008-4560-9073-31852dc7f3bc None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb713-3008-4560-9073-31852dc7f3bc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bb713-3008-4560-9073-31852dc7f3bc None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 200/403] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:39.711208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb713-3008-4560-9073-31852dc7f3bc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.757410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.758332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.758685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.759030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.759894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:39.760304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.761765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff4d7c-0e85-429a-a19c-cca71f839430 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.768002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.773881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 204/404] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.779684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.779983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.780404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.801902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:39.803323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:39.838315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:39.852444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bb713-3008-4560-9073-31852dc7f3bc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:39.882976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 205/405] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:39.884280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:39.915147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:39.916039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:39.916320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:39.916593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:39.918327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:39.919789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:39.921495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 201/406] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:39.922321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.006400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4341a-2113-4453-979e-62faa15a8873 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.051392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabb9a8-a274-4fa4-b817-72c9dbeca6d2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.061860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.063304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.063809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.064279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.066216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.068101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.075265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 206/407] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:40.076647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.087935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.103963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.105026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.105348 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.105586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.118116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:40.126939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:40.127864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:40.128661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:40.129260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.131949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 202/408] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:40.132810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.201645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73dfac-b9e7-4282-a611-410c357a5cc4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.238513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.239493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.239785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.240033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/groups/9219e86037d34536a79034d8b1904346/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.240408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eda22-b552-4371-a522-c08dc5498246 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.242022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, group_id=9219e86037d34536a79034d8b1904346, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.243454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502f08-8411-4776-b266-c9e88988e2e1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.276620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.277457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.277740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.278016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.279192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.280654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.282342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 203/409] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:40.283096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.324228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.340542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 207/410] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jul 25 05:50:40 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/groups/9219e86037d34536a79034d8b1904346/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:40.340542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4032-37e8-48b1-bc1e-c550fd3c8811 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.340542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4032-37e8-48b1-bc1e-c550fd3c8811 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.340542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe4032-37e8-48b1-bc1e-c550fd3c8811 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.345692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 208/411] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:40.345692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4032-37e8-48b1-bc1e-c550fd3c8811 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.403765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73fbc-9536-40fd-812b-76cc95521400 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.440932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.441666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.441948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.442765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.443517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:40.443889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.445276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf7990-0e6d-47a7-9ca2-f994890d61dc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.459636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 204/412] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:40.461209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.461497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.461771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.480644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:40.481916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:40.482247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.493077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe4032-37e8-48b1-bc1e-c550fd3c8811 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.536583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.536881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.536962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.537484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9/groups/9219e86037d34536a79034d8b1904346/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.541902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] RBAC: Authorizing `identity:create_grant(project_id=771d014e7c874f49b7d1871a58a042b9, group_id=9219e86037d34536a79034d8b1904346, role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.544422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.563874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 205/413] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:40.564556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.597569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.615100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 209/414] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jul 25 05:50:40 2022] PUT /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9/groups/9219e86037d34536a79034d8b1904346/roles/806a50b089f44cb48562ccf8ff703763 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:50:40.623803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.735239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7d4f1-76ce-4acf-b330-8816175286bd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.784135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.785776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.786062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.786342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] PATH_INFO: `/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.787903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] RBAC: Authorizing `identity:get_group(group_id=9a0d124ea8bf4a2eaadd1bb212b3250a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.789369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.795580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 206/415] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:40.798782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.833466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f48dcd-6ac3-40d4-98af-ecc199ab0358 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.871972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.873203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.873689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.874059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.886042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:40.894341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:40.896013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:40.896909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 210/416] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:40.904070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:40.919426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.922938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac1a9a2-b9b2-41db-af59-4a7defb12cb2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:40.924824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:40.981203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:40.982086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:40.982373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:40.982653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] PATH_INFO: `/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:40.988299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] RBAC: Authorizing `identity:get_project(project_id=1ff9f2a23bd646d2af236b8a1efad9a1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:40.990371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:40.992454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 207/417] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:40.998005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:41.037087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e12919-79cf-45de-98ea-a0e7b28451a0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.075944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.076623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.076907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.077280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.078068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:41.078424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.079798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.089567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 211/418] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:41.094825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:41.170405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312f375-c1af-4dc1-8dc8-c6b6057e87a9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.181662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:41.205525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f396c5c-878a-4a3d-b64e-791f8cf13d8f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.240660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.241561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.241847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.242555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.243046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] PATH_INFO: `/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1/groups/9a0d124ea8bf4a2eaadd1bb212b3250a/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.243132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.243201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.243612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.244162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] RBAC: Authorizing `identity:create_grant(project_id=1ff9f2a23bd646d2af236b8a1efad9a1, group_id=9a0d124ea8bf4a2eaadd1bb212b3250a, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.245595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.314420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.315899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.342206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 208/419] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jul 25 05:50:40 2022] PUT /identity/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1/groups/9a0d124ea8bf4a2eaadd1bb212b3250a/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:50:41.400713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:41.426108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 212/420] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:41.432910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:41.464629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:41.545576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb207-0734-4a80-bb41-57de1a525313 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.584649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.585537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.585818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.586092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.587297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.588796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.590890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 209/421] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:41 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:41.596946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:41.708055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24bf1-f026-4440-96f6-d213655497ff None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.746347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.747214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.747493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.747795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.748973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.750405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0f629-87fc-4cef-b525-56c1b0f80259 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.752361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 213/422] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:41 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:41.758241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:41.892591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:41.900014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdc55d-f2d8-4483-8471-04e7e540c3fc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:41.944053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:41.944722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.945011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.945294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.946129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=10e9ac13954549a2b146650679c400cf) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:41.946442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:41.947905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c89ee7-a0e2-44bb-8471-19549330c9f9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:41.958737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 210/423] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:41 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=dfc30452d78d40f6911291710cd6601e => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:41.995536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21316a-6424-43b3-818a-0f8c15524042 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:41.995858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21316a-6424-43b3-818a-0f8c15524042 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:41.996130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21316a-6424-43b3-818a-0f8c15524042 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:41.997713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 214/424] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:42.002968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.003264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.003579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.026311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:42.027542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:42.138244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 211/425] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:42.174705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21316a-6424-43b3-818a-0f8c15524042 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:42.233706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:42.295796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21316a-6424-43b3-818a-0f8c15524042 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:42.334837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:42.335957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.336387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.336808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.347979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:42.356751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:42.357833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:42.358857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:42.361286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 215/426] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:42.372664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:42.475092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:42.486850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97d54-e932-42c3-ba83-cea65a34d1ca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:42.523223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:42.523936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.524225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.524511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.525269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:42.525580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:42.526987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba1464-a6c1-40a6-8f1f-34286c19fb72 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:42.537055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 212/427] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:42.543210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:42.652917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41627043-9016-4ace-bf3e-37c417ac69e9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:42.655288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:42.690742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:42.691411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.691731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.692039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.763952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:42.765335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:42.784115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5d17-da9f-4df0-8625-3ccbce8e92b6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.784397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5d17-da9f-4df0-8625-3ccbce8e92b6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.784684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc5d17-da9f-4df0-8625-3ccbce8e92b6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.786958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 213/428] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:42.797165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:42.797768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:42.798589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:42.816756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:42.819101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:42.870696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:42.876018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:42.880097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:42.904735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 214/430] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:42.932236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.004794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a83dfa-d754-47f2-abae-5cd449028a1c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.052781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.052933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.054067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.054360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.054644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] PATH_INFO: `/v3/projects/10e9ac13954549a2b146650679c400cf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.055895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] RBAC: Authorizing `identity:get_project(project_id=10e9ac13954549a2b146650679c400cf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.057362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.059432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 217/431] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:42 2022] GET /identity/v3/projects/10e9ac13954549a2b146650679c400cf => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.065301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.075874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b136fe-e537-403b-ad29-499ff5d9e535 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.114197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.115356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.115875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.116381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.128417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:43.137904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:43.138810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 05:50:43.139626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:43.142433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 215/432] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:43.148379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.151343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.182569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03148b-ea48-42b1-9b36-e03af803e4dd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.217531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.218455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.218745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.219075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.220280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.221772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.224398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 218/433] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.229652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.267278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468e232-5e9a-43e7-8658-e5f597f3e89d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.305517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.306622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.307111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.307626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.308612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] RBAC: Adding query filter params (name=member) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:43.309118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.310692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b55af-8d8d-48b8-b56c-465d1766a240 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.319802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 216/434] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.321043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd4bb-a05e-4978-ada4-c555feaf78a4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.321328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd4bb-a05e-4978-ada4-c555feaf78a4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.321605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7fd4bb-a05e-4978-ada4-c555feaf78a4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.323019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 217/435] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:43.325093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fd4bb-a05e-4978-ada4-c555feaf78a4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.328119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.341823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94500096-5277-45e5-8462-09250b7391d0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.376690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.377349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.377637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.377917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.378744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=10e9ac13954549a2b146650679c400cf) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:43.379057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.381312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072c40-2730-4d1f-94d7-613e4b09aa9c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.394755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 219/436] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=10e9ac13954549a2b146650679c400cf&role.id=806a50b089f44cb48562ccf8ff703763 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.394755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.394755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.394755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.402479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.408343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:43.409576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:43.459399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7fd4bb-a05e-4978-ada4-c555feaf78a4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.502319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.503189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.503479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.503868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.505720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 220/437] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:43.530893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.591269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.592679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.594568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.650497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b079fba-aaa8-4705-9d34-817bb93bc890 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.694307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.695133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.695420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.695736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.697732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.709150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:43.717614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:43.718542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:43.719495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 221/438] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:43.725175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.739381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 218/439] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:43.746575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.850721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d3c1-db40-418f-ad7b-ca57e5c8c346 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.877726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cbe97-9e96-4b18-a85d-d0978c1d9fad None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:43.880795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:43.900677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.901071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.901295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.901569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.902330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:43.902646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.904079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.913532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 222/440] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.919122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.923979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:43.924841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:43.925121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:43.925393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:43.926792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:43.928462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:43.930297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 219/441] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:43.935379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:43.978484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.022979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade6478-fe5f-4536-9e88-6eeeb5823e64 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.037651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038898c9-b219-4525-bfc1-8573396903cd None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.056751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.057405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.057687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.057962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.072014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.072867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.073151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.073428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.074590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.076056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7437ff5-065f-49c5-afac-876552141434 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.077652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 220/442] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:44.078862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beada39-deaf-4d4f-838a-b19aff59c17b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.079151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beada39-deaf-4d4f-838a-b19aff59c17b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.079651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beada39-deaf-4d4f-838a-b19aff59c17b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.083607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 221/443] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:44.084070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beada39-deaf-4d4f-838a-b19aff59c17b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.127120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.127486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.128529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f3481-6ed2-4178-9698-6a7c050b9d24 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.185549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.194238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beada39-deaf-4d4f-838a-b19aff59c17b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.228014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.228674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.228965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.229248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.230074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=dfc30452d78d40f6911291710cd6601e, scope.project.id=771d014e7c874f49b7d1871a58a042b9) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:44.230260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 223/444] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:44.230412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.231528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.231846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.231937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.232134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.237941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 222/445] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=dfc30452d78d40f6911291710cd6601e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:44.239420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.263435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:44.264849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:44.344884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 224/446] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:44.355795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f79058-ae7d-4bcf-8f60-03940fdd167d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.357929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.369322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.394051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.394860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.397074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.397355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] PATH_INFO: `/v3/projects/771d014e7c874f49b7d1871a58a042b9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.398580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] RBAC: Authorizing `identity:get_project(project_id=771d014e7c874f49b7d1871a58a042b9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.400068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.401766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 223/447] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/projects/771d014e7c874f49b7d1871a58a042b9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:44.407421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.472920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.490772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457623db-dc9c-4437-a93c-62e2941b8c83 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.529469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.530070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.530357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.530642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.537543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfe6a5-0203-416a-9449-f5ef466fcf05 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.543108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:44.551263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:44.552399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:44.554493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 225/448] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:44.559510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.580421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.581283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.581568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.581845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] PATH_INFO: `/v3/groups/9219e86037d34536a79034d8b1904346` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.584108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] RBAC: Authorizing `identity:get_group(group_id=9219e86037d34536a79034d8b1904346)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.585555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.587177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 224/449] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/groups/9219e86037d34536a79034d8b1904346 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:44.592851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.636550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.675328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ecb0-d60f-4dfb-be29-88c3a122c606 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.696856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d3c6a-7703-45c6-a7a6-ee1ecc872e56 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.710543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.711206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.711489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.711797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.712537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:44.712842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.714195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.722268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 226/450] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:44.728479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:44.730526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.731188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.731472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.731780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.732610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] RBAC: Adding query filter params (group.id=9219e86037d34536a79034d8b1904346, role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=771d014e7c874f49b7d1871a58a042b9) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:44.732922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.734325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.740556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:44.741619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 225/451] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/role_assignments?group.id=9219e86037d34536a79034d8b1904346&scope.project.id=771d014e7c874f49b7d1871a58a042b9&role.id=806a50b089f44cb48562ccf8ff703763 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:44.837129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8ab9-eb9e-41a9-aeeb-b623807add20 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:44.872987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:44.873658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:44.873946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:44.874224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:44.942017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:44.943618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:44.953959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:45.047325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 227/452] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 05:50:45.052431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.150426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b330e0e-623f-424a-8022-2e2e62bb1883 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.151915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:45.184032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.184883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.185171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.185443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] PATH_INFO: `/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.186599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] RBAC: Authorizing `identity:get_project(project_id=1ff9f2a23bd646d2af236b8a1efad9a1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.188053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.189712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 226/453] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:50:45 2022] GET /identity/v3/projects/1ff9f2a23bd646d2af236b8a1efad9a1 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:45.195605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.292120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81edbf-f9dd-4cf7-bb15-beb593508f32 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.301167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:45.324664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.325499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.325781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.326055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] PATH_INFO: `/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.327207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] RBAC: Authorizing `identity:get_group(group_id=9a0d124ea8bf4a2eaadd1bb212b3250a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.328662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab38e29-69ff-46ea-8cb6-6cd3cc847da0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.330245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 228/454] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jul 25 05:50:45 2022] GET /identity/v3/groups/9a0d124ea8bf4a2eaadd1bb212b3250a => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:45.336994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:45.434801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d65c5-c9d9-445d-a563-cd0465d9fe1f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:45.467281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:45.467890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:45.468172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:45.468446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:45.469255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] RBAC: Adding query filter params (group.id=9a0d124ea8bf4a2eaadd1bb212b3250a, role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=1ff9f2a23bd646d2af236b8a1efad9a1) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:45.469562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:45.471011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bdd204-ae41-43f6-9f64-a41dd024630e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:45.477754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 227/455] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jul 25 05:50:45 2022] GET /identity/v3/role_assignments?group.id=9a0d124ea8bf4a2eaadd1bb212b3250a&scope.project.id=1ff9f2a23bd646d2af236b8a1efad9a1&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:48.036152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49aa15-4ad0-485f-9e7a-da3dae7e578f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.036665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49aa15-4ad0-485f-9e7a-da3dae7e578f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.036741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49aa15-4ad0-485f-9e7a-da3dae7e578f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.038069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 229/456] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:48.050812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.051343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.051608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.060891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263698cb-3331-406e-b72d-93bb650b9892 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.061180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263698cb-3331-406e-b72d-93bb650b9892 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.061462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263698cb-3331-406e-b72d-93bb650b9892 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.063977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 230/457] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:48.068236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.068980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.069465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.085013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:48.086211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.105332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:48.106524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.123924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.181891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 228/458] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:48.229473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.233655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 231/459] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:48.260170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.396704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6bfaae-d823-4256-9616-826ce6938f77 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.439123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.440228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.440658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.441078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.450133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2580b0-d3d6-4b92-8a4a-d0594fa39694 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.458013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.467859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.490497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.490629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.490629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.490629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.490629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.497767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.499218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:48.502031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:48.502880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:48.503735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:48.503735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:48.503735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:48.503735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:48.506646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 229/460] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:48.512612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:48.518077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:48.518932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:48.519995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:48.519995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:48.519995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:48.519995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:48.519995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 232/461] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:48.525581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.544284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.640662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645040ac-9417-4754-b8e8-8a7aebc8c25e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.647509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7d353-5758-413a-9440-f76b0a7b1521 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.679360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.680219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.680512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.680836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.681704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:48.681952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.683322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b88e9-282d-4622-bc24-8b063b2d7f61 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.687162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.688115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.688605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.689103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.690128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:48.690649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.693024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7d2ba-a119-4dc2-8d7c-e2169a077749 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.696172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 233/462] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:48.697682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7068-d4a7-4e88-897f-24a650071931 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.697958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7068-d4a7-4e88-897f-24a650071931 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.698238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e7068-d4a7-4e88-897f-24a650071931 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.703545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 234/463] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:48.704348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e7068-d4a7-4e88-897f-24a650071931 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.713740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 230/464] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:48.720158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.720789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.721293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.725452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.741011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:48.742562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:48.814845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 231/465] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:48.816032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:48.816525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e7068-d4a7-4e88-897f-24a650071931 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.826979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:48.862815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.864020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.864306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.864584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.865639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.867730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833f926-78fd-48eb-921b-05fa07e84825 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.924139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30ec72-6363-4f62-8e9b-0f27bd069e96 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:48.958446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:48.959117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.959404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.959714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.960411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:48.961875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07390a-18de-4187-9f01-694bfac674b0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:48.988269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 235/466] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:48 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:48.989422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda7fa-d078-42e4-a155-6d56c4ba5662 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:48.989715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda7fa-d078-42e4-a155-6d56c4ba5662 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:48.989997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dda7fa-d078-42e4-a155-6d56c4ba5662 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:48.995640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 236/467] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:48.995640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dda7fa-d078-42e4-a155-6d56c4ba5662 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.063776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 232/468] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:48 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:49.065995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f35-b6fc-4b8b-821d-175830f33388 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.066537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f35-b6fc-4b8b-821d-175830f33388 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.067654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3459f35-b6fc-4b8b-821d-175830f33388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.090749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b3459f35-b6fc-4b8b-821d-175830f33388 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.093073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b3459f35-b6fc-4b8b-821d-175830f33388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.124964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.176993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.186620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dda7fa-d078-42e4-a155-6d56c4ba5662 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.190277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 233/469] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:49.192850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08b88-9ae4-46f1-bb7b-0c1658894d9b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.193383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08b88-9ae4-46f1-bb7b-0c1658894d9b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.193972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b08b88-9ae4-46f1-bb7b-0c1658894d9b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.195690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 234/470] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:49.201870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.202173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.202432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.226996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:49.228772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:49.242396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.243540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.243877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.244162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.258387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.259953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:49.282641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:49.283540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:49.284846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:49.284846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:49.284846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:49.284846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.284846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 237/471] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:49.285118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.322324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 235/472] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:49.323366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.416504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b0a98-d661-4a3b-9f3f-a79f7a00b795 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.450364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.453065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6d440-44d9-40c2-8884-525e43dc3098 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.460932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.462017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.462459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.464300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.475682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.477622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.482515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.496700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.497370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.497655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.497930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.498661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:49.498970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:49.500071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:49.500867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:49.501715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:49.501715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:49.501715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:49.501715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.501932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.504493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 238/473] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:49.505646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.514343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 236/474] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:49.515203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.620049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8411a1d6-9805-406e-965e-bc49637a3f48 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.656112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.656744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a069f97-4180-4e66-bd5b-a5cef125e811 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.657358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.657838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.658309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.659276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.662107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.693339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.694009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.694296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.694575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.695292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:49.695638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.697123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.700182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.sql.core [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:50:49.700182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 05:50:49.700182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [parameters: {'id': 'b52a10b380ba427e95e6a321cc1d1e88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 05:50:49.700182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80337) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:50:49.717656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 237/475] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result.read() Jul 25 05:50:49.717803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return ref.to_dict() Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:50:49.718590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application yield resource Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise self.value Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application session.commit() Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:50:49.719466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:50:49.720685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:50:49.721545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result.read() Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:50:49.722335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [parameters: {'id': 'b52a10b380ba427e95e6a321cc1d1e88', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:49.723395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 25 05:50:49.733043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.734053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.734140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 239/476] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/roles => generated 144 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:49.734140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.784679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.787588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:49.845772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e65aa-5d0b-4a9a-97d9-8b62bd6dcef6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.850833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e084b-dd2d-4168-aa2e-93c537da0cce None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:49.887536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.888288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.888571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.888847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.889550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:49.890966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:49.891394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:49.892547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:49.893031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:49.893534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:49.907199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:49.917080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:49.917993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 05:50:49.918886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:49.925117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 240/477] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:49.925117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:49.983706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 238/478] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/users => generated 248 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:49.984712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:50.048788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1405d64f-bfb8-4013-ae98-7a034e31a56e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.050768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:50.106607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.107301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.107598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.107877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.108593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.110044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33e2127-4213-489b-966a-fac54f45349d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.167068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:50.172250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851d0c7-19b6-4f46-829b-bc501e3790d8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:50.217067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 241/479] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:49 2022] POST /identity/v3/users => generated 249 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:50.225587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:50.226294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:50.226578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:50.226855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:50.227743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:50.228061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:50.229553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b320e28-a26f-4010-bfe8-e56a46fbbbfb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:50.245105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 239/480] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:51.456915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3552c-2789-4cb9-8a70-3dc2f6444075 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.457974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3552c-2789-4cb9-8a70-3dc2f6444075 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.457974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3552c-2789-4cb9-8a70-3dc2f6444075 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.459574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 242/481] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:51.464944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479601-7c10-496d-9120-3121396226bb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.465359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479601-7c10-496d-9120-3121396226bb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.465527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479601-7c10-496d-9120-3121396226bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.492526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-16479601-7c10-496d-9120-3121396226bb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:51.493725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-16479601-7c10-496d-9120-3121396226bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:51.516457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a8fc-3ac4-4f2d-9e3c-733a4add18c8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.516751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a8fc-3ac4-4f2d-9e3c-733a4add18c8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.517031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133a8fc-3ac4-4f2d-9e3c-733a4add18c8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.518622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 243/482] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:51.523980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.524269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.524549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.541868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:51.543247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:51.614223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 240/483] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:51.619654 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 244/484] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:50:51.639526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479601-7c10-496d-9120-3121396226bb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.648262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.783504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479601-7c10-496d-9120-3121396226bb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.792057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:51.823177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.824004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.825136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.825433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.837069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:51.845756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:51.846613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:51.847397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:51.851673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 241/485] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:51.853192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:51.857725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:51.883962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94076c4-2009-4e71-8a6b-f736737db15e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.968762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:51.969557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:51.969838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:51.970110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:51.980458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b90053-019c-45ae-87fb-2b5783bac4e7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:51.981243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:51.989801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:51.990697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:51.991532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 245/486] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:51.996663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.032179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.032856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.033139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.033416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.034224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:52.034478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.035942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.052047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 242/487] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:52.060512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.091136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.201011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d48de5-6e8b-4fdc-aba0-999012d4511d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.235182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7d2f8-74ca-4ea3-b3ba-1f6d20eeaaf2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.257436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.258120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.258403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.258678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.259429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:52.259761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.261129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.280106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 246/488] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:52.283872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.303029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.305374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.306182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.306468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.306746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.326200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.327747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:52.365300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:52.366200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:52.367048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:52.367048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:52.367048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:52.367048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:52.372602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 243/489] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:52.374532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.475299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950eee-3f26-4a04-9f4f-677172d71bae None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.490879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.539277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.540110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.540393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.540669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.557014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b55156-87e7-46b7-8082-f64dccc8e6f1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.561108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.562571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:52.592765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:52.593683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:52.594496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:52.594496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:52.594496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:52.594496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:52.595319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 247/490] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:52.608657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.624453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.625126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.625413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.625749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.626480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:52.626835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.628239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.649846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 244/491] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:52.658730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.722659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.765792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a0ee2-89bb-4793-9905-63fec9b4fa3e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.797551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99a5f9-89b4-4f0c-b4f5-b01f28ee60d2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.802696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.803363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.803683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.803964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.804686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:52.804992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.806353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda5471-565f-4236-a6f2-850b81507f47 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.820001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 248/492] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:52.821210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44143-0d61-426b-80e0-7b9ec9064559 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.821495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44143-0d61-426b-80e0-7b9ec9064559 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.821773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a44143-0d61-426b-80e0-7b9ec9064559 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.822988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 249/493] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:52.824090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c6f8-1aaf-4c9f-a016-c230c6a3c02f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.824373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c6f8-1aaf-4c9f-a016-c230c6a3c02f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.824649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786c6f8-1aaf-4c9f-a016-c230c6a3c02f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.826107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 250/494] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:52.829397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786c6f8-1aaf-4c9f-a016-c230c6a3c02f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:52.831133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.841751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.842562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.842879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.843166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.850952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.852432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bc25f364-bdbd-4f3a-8fbb-9746e87428dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:52.869080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:52.870014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:52.871074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 245/495] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:52.873311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6afb-d558-48b4-ba2f-2fb83996b1f6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.873603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6afb-d558-48b4-ba2f-2fb83996b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.873885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c6afb-d558-48b4-ba2f-2fb83996b1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.889686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-511c6afb-d558-48b4-ba2f-2fb83996b1f6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:52.890864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-511c6afb-d558-48b4-ba2f-2fb83996b1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:52.935015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786c6f8-1aaf-4c9f-a016-c230c6a3c02f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:52.955340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 246/496] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:52.956716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.957011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.957298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.958985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:52.970396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:52.971134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:52.971414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:52.971747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] PATH_INFO: `/v3/users/glance` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:52.973898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:52.975098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:52.981236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:52.982774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-cb273c03-0748-4d06-a534-b9b98c923bcf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:52.999616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:53.000519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:53.001389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 251/497] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:53.002453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f9a1-c4ce-4da1-bab0-8812bbb9a89b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.002658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f9a1-c4ce-4da1-bab0-8812bbb9a89b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.002930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819f9a1-c4ce-4da1-bab0-8812bbb9a89b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.004410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 252/498] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:53.005001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f9a1-c4ce-4da1-bab0-8812bbb9a89b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.049701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 247/499] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:53.050543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.097740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.109118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819f9a1-c4ce-4da1-bab0-8812bbb9a89b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.142670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.143333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.143644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.143927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.145369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:53.145812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.147279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.150960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e3626-1aa1-40a2-937e-dc3b4470b486 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.184885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 253/500] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:53.185275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.185501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.186073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.186358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.186648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.198347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-4446f1ef-a471-4c47-bece-e419802bb9aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:53.206081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:53.206967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:53.208527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 248/501] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:53.209450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.209450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.209641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.225208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:53.226404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:53.229873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.289756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c212-8577-4591-85b9-9f2167183001 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.292832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 249/502] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:53.293655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.325168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.325845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.326128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.326405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.327238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:53.327549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.329009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.333637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.346400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:53.347211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.399032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a74e8f-0568-4575-9774-fa4a5498a7da None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.433329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.434116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.434403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.434679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.443642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.444996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:53.447492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73238f-50bb-49f9-80a7-7879747dd287 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:53.452844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:53.453727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:53.454524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:53.455925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:53.456738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.481724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.482380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.482670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.482948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.549709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.550139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.551228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.556818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530b993-89db-4375-badb-75d8d8997b34 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.590451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.591116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.591401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.591708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.592446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:53.592754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.594136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.602616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 251/505] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:53.603400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.650939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.655707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 255/506] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:53.656507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.704405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a9157-eaa3-46f9-8cbf-137bc02dce7f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.737301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.738097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.738469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.738914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.749424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.750855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.751872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e0eed-4506-4122-ae60-fc86bdc9707b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:53.770520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:53.771501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:53.772787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:53.772787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:53.772787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:53.772787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:53.772787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:53.773250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.784181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.788059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.788720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.789007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.789294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.853576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:53.856922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.858397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.873127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d2746-ae08-4fd9-9298-236d1686d5b2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:53.908106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:53.908700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:53.908983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:53.909260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:53.909995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:53.910501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:53.912192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:53.919885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 253/508] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:53.924893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.957798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 256/509] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:53.959042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:53.992427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.022307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6addbc29-464e-4b24-8cdf-459c33b0b234 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.059191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.060023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.060306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.060583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.060861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.064682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dad5bc-f444-4ac2-9dcd-d086bec9251f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.071317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.073768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:54.090459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:54.091314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:54.092201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:54.092201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:54.092201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.092201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:54.092201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 254/510] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:54.092467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.104403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.105193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.105472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.105746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.115765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.117228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:54.134359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:54.135336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:54.136415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:54.136415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:54.136415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.136415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:54.136415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 257/511] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:54.136682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.195115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a3eed-b0ba-483e-9b5b-3332284cc6a0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.222215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.233865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.234534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.234822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.235100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.235855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:54.236164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.237532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.238303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2460b-cd64-4502-8412-859e423e9891 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.248982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 255/512] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:54.249774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.272359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.273157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.273953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.274238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.284591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.286653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:54.303584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:54.304442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:54.305278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:54.305278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:54.305278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.305278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:54.305278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 258/513] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:54.305536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.311414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.352720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a673caf-aa97-4b4c-adfd-b3ab54fc1bb9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.386773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.387574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.387874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.388154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.398387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.399885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.413327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105d5a0-3e3c-41dd-bfed-956998daf630 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:54.418038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:54.418914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:54.419806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:54.419806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:54.419806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:54.419806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:54.419806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 256/514] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:54.420376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.449029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.449626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.449914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.450465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.451186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:54.451491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.452875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.454482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.464632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 259/515] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:54.465401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.520952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042db74-49d0-457e-893b-74f82bb6e356 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.529170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.555143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.555831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.556115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.556393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.557098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:54.557404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.558758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.568602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55293f36-9139-4877-b56c-3d96b4a13a3f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.570683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 257/516] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:54.571472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.607311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.608008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.608295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.608572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.609588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.610755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.663017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.669118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f639b3-ff89-433a-9985-d1df5cccd8ef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.701583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.702179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.702580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.702864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.703294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 260/517] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:50:54 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:50:54.703601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:54.703915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.704152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.705359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.719458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 258/518] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:54.720728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.830324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cf18c-caff-4618-92c0-73047f661561 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.842440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7780660-afeb-40f9-b5e8-ba038a772e66 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:54.850747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:54.871277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.872160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.872442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.872727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.873466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:54.873777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.875172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.881090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:54.881894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:54.882179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:54.882487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:54.890655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 261/519] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:54.891314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.893713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:54.903334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:54.911112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:54.912089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:54.912981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 259/520] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:54.913529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:54.931126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.010496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf01ceb-c2b5-4def-ad51-c5cf1bf9687c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.022303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc49e4-1637-4e2a-bf0a-33ab5c8fbc96 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.054567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.055182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.055469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.055783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.062594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.062864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.063393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.063709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.063989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.064292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.072462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.073881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:50:55.079973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:55.080823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:55.081835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 262/521] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:55.082373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:55.093717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:55.094650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:50:55.095540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:55.096720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 260/522] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:55.103643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.124224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.182674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.189015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426349c3-32da-4e4e-a861-77df4e9a404d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.210693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf826aa-988c-466a-9442-1f9fd6b41480 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.227365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.228198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.228485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.228763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.238187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.239964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.248705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.249381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.249668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.249949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.250783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.251093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.252530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:50:55.254999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:55.255978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 263/523] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:55.256834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.303128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 261/524] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.304484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.357306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.361546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a7af4-7991-490f-8189-0368c6a9093d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.397246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.397912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.398200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.398471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.399257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.399593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.401013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.418897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779cbd3-5c20-4933-b6e4-df4a5eb7de5f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.424165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 264/525] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.424915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.451699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.457184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.457864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.458157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.458434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.459271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.459665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.461049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.482899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 262/526] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.482899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.532665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754c82b-7a61-4b8d-86dc-b52ed551e6c0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.571638 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.572615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.573057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.573478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.574402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.574848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.576809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.590520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 265/527] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.591471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.596492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ed5a9-7023-4fc2-94e1-ea5aaa28ee47 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.615951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.633844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.634495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.634776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.635081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.759920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.770451 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e6ebd6-a0e6-4273-8566-4cb4e50ebda0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:55.770724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.772213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.809248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:55.810017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:55.810301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:55.810580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:55.811405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:55.811746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:55.813161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:55.819296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 266/528] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:55.824705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.890674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 263/529] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:55.891664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:55.945228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:55.967258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3ac0-2da1-4e93-ba42-aea3a0c2baca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.009529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.010690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.011186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.011697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.017245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.028556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4121f52-6bf3-440b-9726-60ca2223fc45 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.071705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.072239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.072528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.072808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.073638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=ed6cf63615e341518b142f986915e404) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:56.073951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.075543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.081731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 264/530] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/role_assignments?user.id=ed6cf63615e341518b142f986915e404&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:56.082682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.102310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.104222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.198048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.219688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 267/531] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:56.227607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451b19a-ebc5-4f14-b1a6-7bc9a59c5f48 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.228870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.307281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.312950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.313426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.313855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.333307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.335806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:56.356050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:56.357143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:56.358201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:56.358201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:56.358201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:56.358201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:56.360079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 265/532] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:56.368599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.379976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.444284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e0016-731a-4464-9913-5da7a850f7d9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.513230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.514049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.514336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.514613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.524721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be89e0-9845-4149-95ca-b6d0d7dab7a6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.540680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.542167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.564139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:56.572732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:56.573793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:56.574665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:56.574665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:56.574665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:56.574665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:56.576482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.576679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.577022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.577204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 268/533] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:56.583109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:56.583109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.583109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.583549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.602781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 266/534] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:56.609323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.647581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.701979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b511038-ff1d-4edc-908a-54d8c48e5696 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.711971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.740464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215e61-5606-479d-ad83-251837252c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.741088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e61-5606-479d-ad83-251837252c78 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.741371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e61-5606-479d-ad83-251837252c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.741823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11215e61-5606-479d-ad83-251837252c78 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.742711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215e61-5606-479d-ad83-251837252c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:56.743014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215e61-5606-479d-ad83-251837252c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.744423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11215e61-5606-479d-ad83-251837252c78 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.756835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 269/535] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:56.762185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215e61-5606-479d-ad83-251837252c78 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.802084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780963f-e5a9-4d31-9170-f34db64966f4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.872030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11215e61-5606-479d-ad83-251837252c78 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:56.880048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:56.899930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.904539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.904539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.904539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.909059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.911417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.919116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:56.919951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.920237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.920511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.928459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-113b6b06-13db-449c-bac0-2820e1e49124 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:50:56.929012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:56.930004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:56.931068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:56.931488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:56.933324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 267/536] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:56.934800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b06c62-7945-4493-a114-a54eb8b98d16 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.935269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b06c62-7945-4493-a114-a54eb8b98d16 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.935749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b06c62-7945-4493-a114-a54eb8b98d16 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.937506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 268/537] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:56.942547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b06c62-7945-4493-a114-a54eb8b98d16 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-657f7595-9cc7-41bb-a8f3-2839fe336b4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:50:56.945531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:56.946363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:56.947210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 270/538] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:56.952351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:56.952648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:56.952933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:56.970989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:56.972298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:57.055578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 271/539] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:57.055578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.069352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b06c62-7945-4493-a114-a54eb8b98d16 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.109910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:57.119505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.120374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.120924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.121366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.122455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:57.122911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.124627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.140149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:57.145432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 269/540] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:57.146450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.159017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeabb4d-a5dd-4f61-9bcf-69af30d835a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.199335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.200146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.200494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.200702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.201498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:57.201807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.204702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.226412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 272/541] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:57.227284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.277676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0646894-d7b3-485a-a56f-f2199e4b0c77 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.339335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.340521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.341033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.341649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.354120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:57.363920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:57.364823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:57.365613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:57.373133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a899ae-7de9-43cb-9fd1-5374c61cf660 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.373389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 270/542] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:57.374519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.420706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.421283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.421571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.421849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.422760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=1f429ab936824983b32150cd5c181210) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:57.423257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.424999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.435767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 273/543] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/role_assignments?user.id=1f429ab936824983b32150cd5c181210&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:57.436730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.459939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:57.487708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:57.594111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f00301-9908-470c-83ff-a33bd7d9830e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.615734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6edf0ae-8ced-4c6b-9e40-a52417fa02ad None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.634453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.635103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.635393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.635700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.636469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:57.636759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.638158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.648483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 274/544] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:57.656571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:57.673183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.674156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.674634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.675066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.676121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=509c7e7fcc7c4ef19c86f1ce27232d59) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:57.677039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.679333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.691059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 271/545] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/role_assignments?user.id=509c7e7fcc7c4ef19c86f1ce27232d59&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:57.772460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:57.808598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b71108-6d39-47f9-97e9-e0e3186de9a4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:57.847044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:57.848543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:57.848978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:57.849403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:57.865824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:57.867713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:57.903493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:57.904569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:57.905712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:57.905712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:57.905712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:57.905712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:57.909749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 275/546] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:57.918668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.051792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dc411-4528-4f95-9f0d-a6e1bc82ff0b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.067086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:58.097176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.098837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.099356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.099877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.100810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:58.101316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:58.102911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:58.116275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 272/547] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:50:58.122466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.272522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8c4c7-0cce-47d6-94ea-cb3d865d1693 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.304054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:58.308604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.309414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.309703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.309982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.318827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:58.320307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-6aa45405-aacc-4ded-8b9a-29003f3fa2a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:58.335742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:58.336904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:58.337806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 276/548] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:58.342917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.390397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf0b8-033e-4b8e-8c5f-15721b8cd580 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.390722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf0b8-033e-4b8e-8c5f-15721b8cd580 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.390964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bf0b8-033e-4b8e-8c5f-15721b8cd580 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.392500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 277/549] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:50:58.397844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.398133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.398417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.424694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:58.426062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:58.487002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628d8ab-35af-4274-a765-9d6300497154 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.542508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 278/550] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 25 05:50:58.565198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.565888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.566173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.566499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.567355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:58.567688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:58.569128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:58.569777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.588077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 273/551] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:58.596519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.639197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:58.704903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e246d2be-2cfc-4749-b001-671752c32e93 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.720626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:58.728075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e543237-3247-4df0-9f50-53b90c59632c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.744630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.745894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.746441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.746917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.759399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:58.762921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.763599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.763989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.764270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9d4cffe4-dcb0-410e-85f9-9c2f3cfea225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:58.769056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:58.770708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:58.771511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:58.778860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 279/552] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:50:58.780682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd31be-4143-4354-968b-888f613431b6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.781178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd31be-4143-4354-968b-888f613431b6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.781678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd31be-4143-4354-968b-888f613431b6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.783478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 280/553] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:50:58.788770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd31be-4143-4354-968b-888f613431b6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.836616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:58.838053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b5372-8f3e-45ba-b78e-cab3316575c9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:58.866853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:58.906149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd31be-4143-4354-968b-888f613431b6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:58.944061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:58.945095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.945595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.946070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.946174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 274/554] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:50:58.947226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:58.947449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:58.947784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:58.948067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:58.948355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:58.950359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:58.964867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 281/555] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:58.966106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:58.966912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:50:58.968171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:50:59.010612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.061938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 275/556] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:50:59.068941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.100966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5accea-c962-468e-8a0b-eb0334f25fad None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.143927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.145303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.145775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.146060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.151314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.159086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.161442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:59.184722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:59.185648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:59.186591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:59.186591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:59.186591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:59.186591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:59.186591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 282/557] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:59.187436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.207167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434c285-d204-41ab-91d6-ba0add3bc18b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.249441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.250403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.250695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.250980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.264695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.266354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:59.287342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:59.288863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:59.289725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:50:59.289725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:50:59.289725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:59.289725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:59.291778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.297513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 276/558] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:59.297513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.306490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d5bc4c-7576-421f-8b53-a07aa93aab10 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.350385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.351729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.351975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.352262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.368672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:50:59.376503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:59.377447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:50:59.378370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:59.382710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 283/559] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:59.383585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.428122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38788d-9962-463b-bbe7-40e9834746ff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.438978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.464864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.465279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.465573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.465857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.466585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:59.466944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.469396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.482457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 277/560] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:59.483369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.520327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86242b7-2b3a-448c-b7fe-9d9aa2467c43 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.562314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.563166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.563523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.564043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.564974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:59.565406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.567074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.586178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 284/561] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:59.586178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.593028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.609946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e137e1-46af-4f2d-bb7b-240a7cb43003 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.653183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.653857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.654144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.654432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.655516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:50:59.655842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.657525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.671611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 278/562] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:50:59.671611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.708608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ccf8b-2fc0-4870-bbe3-e83519c250d5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.710742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.752723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.754124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.754428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.754851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.767152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.769502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:50:59.790270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:59.791401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:50:59.792533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:50:59.795564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 285/563] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:59.796884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.799088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27105dbd-70f6-412d-9f5f-cd66ab9d9d3a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.844026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.845078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.845510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.845934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.857286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.859309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.875576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:50:59.881045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:50:59.882115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:50:59.883192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:50:59.886215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 279/564] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:50:59.887213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:50:59.926337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb38012-c796-423d-a16e-29cd61b15b3d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.963401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:50:59.964336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:50:59.964618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:50:59.964919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:50:59.977693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:50:59.979645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:50:59.987478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:50:59.996568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23df61e-cfc7-497a-b463-b9497103148d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:50:59.999149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:00.000096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:00.000988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:00.000988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:00.000988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:00.000988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:00.000988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 286/565] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:00.005919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.039525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.040233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.040526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.040805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.041597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.041909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.043344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8551801-4db4-4d7a-992f-aac339544f6f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.055347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 280/566] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.056665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cab5-50e7-4277-ab63-0b59882ac8d9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.056940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cab5-50e7-4277-ab63-0b59882ac8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.057221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97cab5-50e7-4277-ab63-0b59882ac8d9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.059595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 281/567] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:00.059595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97cab5-50e7-4277-ab63-0b59882ac8d9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.114335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b2c16-bba0-472b-8bfd-3921d0a99f6f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.131216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.148033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.148734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.149023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.149300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.150172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.150483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.152086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b350a68-3411-4d97-a7df-c92d9998a791 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.161883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97cab5-50e7-4277-ab63-0b59882ac8d9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.171052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 287/568] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.172347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6239af-058f-42e5-bd9b-6a99c6064151 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.172641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6239af-058f-42e5-bd9b-6a99c6064151 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.173186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6239af-058f-42e5-bd9b-6a99c6064151 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.178659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 288/569] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:00.179437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6239af-058f-42e5-bd9b-6a99c6064151 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.197001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.197662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.197948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.198219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.198928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.199231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.200634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac60e55-27df-474d-ad08-465f78a121b0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.212751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 282/570] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.214004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.214298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.214594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.231262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:00.232507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:00.240583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.284550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6239af-058f-42e5-bd9b-6a99c6064151 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.300810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 283/571] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:00.301653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.320806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.321432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.321712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.321983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.322875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=064b2b59c734411e81c488d505deb560) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.323182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.324624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62731a3a-eec7-4494-81e8-b8654c023275 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.330061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 289/572] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/role_assignments?user.id=064b2b59c734411e81c488d505deb560&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.331196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.331483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.331784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.362001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:00.363900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:00.404515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.412920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bdd6b-7971-4bbd-bbf8-f6413593a168 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.442480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 290/573] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:00.443403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.461817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.463579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.464293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.464718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.478974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.480524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.483200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:00.499985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:00.501188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:00.502104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:00.502104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:00.502104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:00.502104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:00.503744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 284/574] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:00.505180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.557729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c0815-71c6-4bd3-ac07-76fc697918af None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.593698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.594496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.594777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.595056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.603024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.604480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.615250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58f15f-c9e6-463e-8137-8f74b21a4561 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:00.621547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:00.622486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:00.623409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 291/575] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:00.624040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.657736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.658212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.659094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.659549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.659817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.671038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:00.679841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:00.680761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 285/576] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:00.682194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.742887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac8a4ee-bf21-4c4f-9e72-cc2970bc61cd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.750142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.781031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.781918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.782265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.782539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.793998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:00.802033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:00.803168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:00.808973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:00.809751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052decd8-8304-4df2-8a15-0cdf898613e1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.809841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 292/577] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:00.809841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.844619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.845435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.845826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.846206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.847033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.847457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.849632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.862328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 286/578] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.863822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.907705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:00.920420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ba4fa-5894-4a6f-854b-6c39c40d6e78 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.958743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:00.959414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:00.959737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:00.960008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:00.960840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:00.961151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:00.962575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:00.969751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a437f27-b2f9-4551-8861-1489faed73a2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:00.982227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 293/579] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:00.983043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:00.990721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.011791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.012476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.012759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.013062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.013780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.014086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.015580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.024965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 287/580] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.026217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.096835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a663c73-7792-4929-b2ce-9ccf9698c0c9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.132401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc51830-0c2b-4503-9502-564630f2ac71 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.132797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.133468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.133750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.134025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.134758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.135061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.136441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.147604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 294/581] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.147604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.158403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.175223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.176948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.177413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.177856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.186723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.188507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:01.204039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:01.204930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:01.205835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 288/582] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:01.206329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.248139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.254450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8393f1-1e23-4955-a72c-11907c69fec5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.291801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.293002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.293290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.293570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.305551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.307258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.317897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914b27b-e89b-4df1-a076-b37681ec519d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:01.325767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:01.326653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:01.327530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:01.327530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:01.327530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.327530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:01.327530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 295/583] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:01.328257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.356694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.357482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.357764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.358035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.368715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.370149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:01.388023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:01.388935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:01.389807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:01.389807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:01.389807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.389807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:01.393791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 289/584] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:01.394491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.398729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.442050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ae828-9f7d-42c6-ad3b-b1e3619ea648 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.480172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.480975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.481265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.481577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.490877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.493634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.495266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.503056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61cd1a3-3522-4d1a-871e-fe3f8a8d8427 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:01.512868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:01.513772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:01.514657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:01.514657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:01.514657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:01.514657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:01.514657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 296/585] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:01.514930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.543282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.543980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.544264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.544535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.545314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.545705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.547044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.559413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 290/586] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.560146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.630749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a8e2e-2275-4419-8824-405da648f802 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.647246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.668238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.668896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.669181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.669484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.670202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.670481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8998a48-c909-4988-b258-7c198fbdde6e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.670923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.671885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.685101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 297/587] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.685905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.712127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.712719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.713003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.713276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.713995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.714318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.715689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.727866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 291/588] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.728626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.740427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.800845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0b95-a519-4895-9d75-b999ea71c4c8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.834824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfad850-82d5-4428-a848-4e4aadb76465 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.839897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.840570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.840861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.841141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.841894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:01.842207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.844028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.861322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 298/589] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:01.861322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:01.874907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:01.875940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:01.876300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:01.876588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:01.892612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=53925cdf5a744200910943966d84ed40, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:01.893855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:01.899482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:01.965274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe10e95-185c-416c-8aa5-547fb9a666ac None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:01.987601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 292/590] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:01 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:01.987601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.022845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.023816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.024113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.024399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.036488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.047585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:02.059185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:02.060146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:02.061023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 299/591] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:02.061840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.072252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.140143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d9d0-90d5-4a28-8e52-a01eea629a0a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.181575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.191179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99572b-1030-44d5-a5ca-52641b3cc912 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.193756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.194572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.194846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.204542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.204542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.204542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:02.221541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:02.222525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:02.223648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 293/592] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:02.224226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.242088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.243408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.243859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.244534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.260937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.262624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:02.282945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:02.284139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:51:02.285887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:02.288780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 300/593] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:02.289889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.339841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281f868-c9e2-4f05-8a5f-2aaef900ab7e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.359250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.379594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.380830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.381424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.381771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.382642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:02.383057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.384789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.401254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 294/594] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:02.402182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.432557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc226a9-30c8-4f8b-9f87-25bc7f2c9c22 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.469092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.469756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.470033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.470472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.471137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:02.471442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.473029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.491780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 301/595] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:02.492596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.509181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.515303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7bfba-10f1-41a6-9172-9cdb74167296 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.554462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.555137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.555465 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.555777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.556759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:02.557139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.558493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec4c50-c04a-4e25-ad6c-c25a647d13ab None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 295/596] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25d32-ca07-4052-aefe-12ec9ac1c150 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25d32-ca07-4052-aefe-12ec9ac1c150 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de25d32-ca07-4052-aefe-12ec9ac1c150 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 296/597] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:02.581338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25d32-ca07-4052-aefe-12ec9ac1c150 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.614948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53670e17-05d6-416c-b580-7c7830be05ae None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.621381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.651434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.652364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.652652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.652934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/ed6cf63615e341518b142f986915e404/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.670018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=ed6cf63615e341518b142f986915e404, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.671855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.695163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de25d32-ca07-4052-aefe-12ec9ac1c150 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.729862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.730964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.731422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.731891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.732606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 302/598] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:02 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/ed6cf63615e341518b142f986915e404/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:02.733429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.756553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.758397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d199a451-c2d8-4f09-bcf2-04f70b2e341a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:02.779794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:02.780936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:02.782121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:02.782121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:02.782121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:02.782121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:02.788060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 297/599] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:02.789662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.790022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.790363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.810331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:02.812064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:02.819372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.868939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba3e24-e889-427d-8776-d6307028b4a6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:02.910334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:02.911234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:02.911522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:02.911830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:02.915588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 298/600] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:02.916795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:02.927940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:02.929491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:02.948922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:02.953179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:02.954306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:02.955409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:02.955409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:02.955409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:02.955409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:02.956222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 303/601] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:02.957622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.059049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5fed1-b6e5-48b4-81ef-7cfafc50dc6d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.096387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445faed1-fd3a-4ca8-b907-d9b358cee33a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.100641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.101265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.101652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.102003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.102804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.103182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.104660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.118149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.119493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 299/602] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.120247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.142467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.143768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.144277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.145286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.158524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:03.167217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:03.168248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:03.169086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:03.171526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 304/603] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:03.178149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.206674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.229771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7259e9e-6809-46a3-91aa-103d5cdc2288 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.265532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.266235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.266524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.266809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.267537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.267891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.269257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.282260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 300/604] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.283177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.290704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9daa-d6a0-4e1f-ad9c-ef1ea37b0f42 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.325570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910ede-5566-410a-a837-9a16de381322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.326466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910ede-5566-410a-a837-9a16de381322 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.326851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910ede-5566-410a-a837-9a16de381322 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.327226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be910ede-5566-410a-a837-9a16de381322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.335040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910ede-5566-410a-a837-9a16de381322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.336640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be910ede-5566-410a-a837-9a16de381322 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-be910ede-5566-410a-a837-9a16de381322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:03.351452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:03.352559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:03.353636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:03.355468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 305/605] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:03.356373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910ede-5566-410a-a837-9a16de381322 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.390391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed84002-c702-4346-b752-bba4937ced52 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.390917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.426799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.427512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.427844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.428141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.429775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.430106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.431630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.436934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.441073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 301/606] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.442669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.467352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be910ede-5566-410a-a837-9a16de381322 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.511726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.512981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.513537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.513825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.522649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.524777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:03.543739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:03.544888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:03.545982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:03.549576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 306/607] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:03.549576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.568487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5706fc-ade9-485e-9ea3-c8496c877ded None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.611839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc046-3293-4837-89fd-03df03349844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.611839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc046-3293-4837-89fd-03df03349844 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.611839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc046-3293-4837-89fd-03df03349844 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.611839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fc046-3293-4837-89fd-03df03349844 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.612250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fc046-3293-4837-89fd-03df03349844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.612250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fc046-3293-4837-89fd-03df03349844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.612250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fc046-3293-4837-89fd-03df03349844 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.621153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 302/608] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.622072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc046-3293-4837-89fd-03df03349844 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.656369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.664006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0898b1d-2bc6-4e11-bebb-d6401f757614 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.684089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.704343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.705457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.705948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.706459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.718554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.720366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.729436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fc046-3293-4837-89fd-03df03349844 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:03.740406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:03.741329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:03.742303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:03.742303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:03.742303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:03.742303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:03.750358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 307/609] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:03.751508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.764875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.765799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.765914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.766198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.767068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.767276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.768748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.787185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 303/610] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.788209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:03.864561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57fa64-4fbb-4606-9381-b5bf085fac1b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.896617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff83c8-a828-4b14-b1c3-c10da0c28ae6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:03.903116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.904390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.904881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.905358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/1f429ab936824983b32150cd5c181210/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.919102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.924334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=1f429ab936824983b32150cd5c181210, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.926127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.929462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:03.934622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:03.938288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:03.949674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 304/611] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:03.950460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.040486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 308/612] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:03 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/1f429ab936824983b32150cd5c181210/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:04.041275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.146140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baba87c-f99e-42b8-8e8f-f5ee62d4c1c3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:04.186047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:04.187013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.187302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.187602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/509c7e7fcc7c4ef19c86f1ce27232d59/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.208475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=509c7e7fcc7c4ef19c86f1ce27232d59, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:04.209940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:04.217176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc55865-3fbf-4984-a5df-1f90f2a61396 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:04.253222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:04.254159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.254580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.254874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.262637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:04.264109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5759a0a7-0318-4153-9e61-729874d84840 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:04.281999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:04.283022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:04.290317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 309/614] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:04.291590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 305/614] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:03 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/509c7e7fcc7c4ef19c86f1ce27232d59/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:04.291674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400449-4f23-4f9c-9c6b-667521b6c9f8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.291674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400449-4f23-4f9c-9c6b-667521b6c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.291674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3400449-4f23-4f9c-9c6b-667521b6c9f8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.296882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.298489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 310/615] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:04 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:04.312983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.313274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.313558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.345732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:04.346984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:04.357409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.459104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.487733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1514669a-4fb4-4a81-8963-0821a8d97b2f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:04.493352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 311/616] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:51:04.520175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.538876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:04.539799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.540208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.540593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.541656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:04.542078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:04.543824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:04.565518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 306/617] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:04.572450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.681553 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa5bef-0ec3-45c7-a7f4-7c76fd8b1e90 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:04.745059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:04.745871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.746155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.746433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.765211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:04.765734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:04.779896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:04.784516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:04.786188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 312/618] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:04.792835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.799061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd217348-5926-428c-970b-992aecdbd671 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:04.843409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:04.844650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:04.845146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:04.845651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:04.858007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:04.859812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:04.882092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:04.883042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:04.883955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:04.883955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:04.883955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:04.883955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:04.887072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 307/619] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:04.898373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:04.908068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.014406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c4b0-49f5-480a-aaaf-5fd54c075a55 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.024547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9001eb-66dd-4226-b7ca-329d88856551 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.054846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.055831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.056324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.056826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.057763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:05.058285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.059882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962ab48-1efe-44ff-86a8-8ecac4c1f3c0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.070688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.070934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.071927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.072335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.072557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.073371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:05.073839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.075359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53248417-4e30-4a90-af86-463c6631cf9a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.076582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 308/620] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:05.078068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fdce7-d48a-4522-b538-6185abdf5fea None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.078559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fdce7-d48a-4522-b538-6185abdf5fea None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.079110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fdce7-d48a-4522-b538-6185abdf5fea None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.080888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 309/621] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:05.082741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fdce7-d48a-4522-b538-6185abdf5fea None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.090971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 313/622] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:05.092294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.092626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.092876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.114641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:05.116473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:05.211593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 314/623] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:05.211593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.216804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0fdce7-d48a-4522-b538-6185abdf5fea None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.254227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.270133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.270741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.271211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.271706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.279343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.281079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:05.299887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:05.301467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 310/624] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:05.302840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.332928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9036679-db1f-4a8b-9284-956e62f8b176 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.372358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.373205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.373492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.373767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.384776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.384998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.386286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:05.405604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:05.407881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 315/625] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:05.410207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.438755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff7fbf-1670-4269-a8bf-49838d0389a0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.474018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.475043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.475432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.475834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.486637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:05.495432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:05.496651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:05.497677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:05.500421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 311/626] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:05.504173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.512191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.527533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b16e3-9b9e-4b2d-921a-6b2446bfc893 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.563323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.564391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.564838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.565347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.567149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:05.567776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.569612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.584038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 316/627] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:05.585190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.620566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349c3311-05ec-4835-93f4-e013c4c43729 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.652315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.664379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.670342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.682009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 312/628] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:05.683090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.706415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3ce4-7402-4936-8c9d-c5dd8bd43091 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.747870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.749114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.749729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.750328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.751341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:05.752006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.753787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.766231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 317/629] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:05.767687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:05.817308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:05.817520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa472d-abc7-48bf-af2f-010879fefad5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.826635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.827677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.828065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.828443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/064b2b59c734411e81c488d505deb560/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.843380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=064b2b59c734411e81c488d505deb560, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.844990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.881695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502d051-6d1a-4f90-b14d-bbe06852ef96 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:05.915340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:05.916157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:05.916440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:05.916716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:05.923966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:05.925390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:05.940531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:05.941599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:05.942629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:05.946588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 318/630] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:05.947330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.055259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae21e8-6815-4bd6-855c-434637ec16cc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.089529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.090250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.090587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.090825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.094114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.103499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.104976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:06.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:06.124979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 319/631] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:06.125893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.155194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 313/632] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:05 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/064b2b59c734411e81c488d505deb560/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:06.159914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.198358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.292744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daad050-9f98-4770-b8af-7e22f6e0753f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.338909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.339683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.339914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.340188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.340945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:06.341252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.342654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff5a6b-6023-4b5c-9d72-92bf1a402adf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.359150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 314/633] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:06.359982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148be57-6f41-4d07-9841-71cc37798269 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.360526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720461d-bd53-4120-9971-09adddef21cb None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.360815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720461d-bd53-4120-9971-09adddef21cb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.361093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8720461d-bd53-4120-9971-09adddef21cb None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.367146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 315/634] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:06.368274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720461d-bd53-4120-9971-09adddef21cb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.395841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.409267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.411720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.411720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.411720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.412099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:06.413987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.413987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ad376-fdc2-4ed7-b72e-bfd540b8f439 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.437126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 320/635] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:06.438511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.438803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.439083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.459123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:06.460432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:06.484541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.499372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8720461d-bd53-4120-9971-09adddef21cb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.543305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.544103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 321/636] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:06.544912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.545104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.545655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.546147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.556614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.559227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-59fbd142-5707-446d-8814-6b464ac2d69f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:06.579268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:06.580463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:06.581403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 316/637] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:06.582085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b5a8-76f6-4083-b3cd-6fe19d882350 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.582373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b5a8-76f6-4083-b3cd-6fe19d882350 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.582645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9443b5a8-76f6-4083-b3cd-6fe19d882350 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.584138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 317/638] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:06.584700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443b5a8-76f6-4083-b3cd-6fe19d882350 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.655269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b388-b196-4eb7-b5f2-875e7e4f9635 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.669710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.693181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.693840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.694130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.694399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.699950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9443b5a8-76f6-4083-b3cd-6fe19d882350 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.736660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.737473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.737757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.738211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.748858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:06.756905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:06.757901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:06.758728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 318/639] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:06.759446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.769902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.771570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d982c-8fd3-4d48-af28-c5dc42e0529c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.775404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.868822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a16176-42ec-4a62-8dda-5857b22c79e5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:06.875759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 322/640] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:06.877222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.877514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.877798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.893740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:06.895444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:06.903297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:06.909805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:06.911309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:06.911767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:06.916814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:06.916814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:06.916814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:06.916814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:06.934447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 319/641] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:06.935507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:06.968294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 323/642] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:06.969324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.014881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.055923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf4e01-d0b0-41f9-85f9-2a87994e0330 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.085485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c9ec6-2399-4b9f-85a9-83732887f9ea None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.096480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.098021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.098606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.099165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.100365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:07.100743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.102558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.114740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 320/643] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:07.115625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.124525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.125439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.125727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.126009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.137417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.138995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.141400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:07.164927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:07.166072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:07.167187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:07.167187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:07.167187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.167187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:07.167881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 324/644] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:07.168727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.231408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1df718-402a-4b13-b11f-fee42adb471e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.261438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.267802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.271730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.271730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.271730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.281252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d7c6-9deb-4f71-aa0f-1166d0e32751 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.317215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.318009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.318322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.318595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.328971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:07.337313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:07.338466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 325/645] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:07.344335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.357017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.358570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.405487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.456424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd4aff-d7b3-4376-8588-b7649b736b18 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.466042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 321/646] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:07.470585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.499631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.499808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.500830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.501174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.501593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.515717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.521157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:07.538702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:07.540071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:07.541457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:07.541457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:07.541457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.541457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:07.544564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 326/647] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:07.545233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.575632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514baed-a9fe-488d-a39a-ce0a46816355 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.612850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.614693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.615048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.615401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.616223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:07.616646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.618069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.630297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 322/648] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:07.631205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.659460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a8aa6-bbe9-4ef2-b131-632f453c4502 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.668665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.701335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.702211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.702679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.703118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.704049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:07.704517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.706026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.715171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 327/649] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:07.716003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.738442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.748055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b4ee6-8792-4753-9a26-a81acd23147d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.789151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.790065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.790345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.790613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.802383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.804402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:07.823231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:07.824336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:07.825286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:07.825286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:07.825286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:07.825286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:07.825935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e7595-09c8-4e15-8cc9-b7fdf12b8be0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.828928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 323/650] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:07.829715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.862264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.863432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.863749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.864033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.864755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:07.865073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.866441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.879790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 328/651] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:07.880536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:07.914630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:07.942455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a44e73-6d08-4a84-9ac5-10b3386d33d0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:07.979412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:07.980247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:07.980538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:07.980819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:07.987883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:07.990064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:07.996384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3da115-075f-4941-8a55-f2c43cf1400a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:08.003929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:08.005277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:08.006166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 324/652] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:08.006664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.009391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.044010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.044807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.045091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.045370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.057598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.059129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:08.077570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:08.078543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:08.079408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:08.079408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:08.079408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:08.079408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:08.079408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 329/653] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:08.080099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.128211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf49da25-9055-4f58-b576-0c253d78fcf7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.162512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.163190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.163480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.163795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.164885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.165205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.166912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.169155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.180170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 325/654] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.181261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.195270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eedbf9-248d-43aa-be16-a4bbe8ccabdc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.231149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.231994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.232280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.232552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.240197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.241627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.247092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:08.256601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:08.261549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 330/655] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:08.262492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.294075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd877a-6c2f-4bea-8978-cc280063e3dc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.330775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.331443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.332339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.332859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.333655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.333968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.335435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.348637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 326/656] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.349446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.378480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e83995-c42f-453d-bc38-5411eec1a00a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.412518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.413178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.413461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.413743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.414456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.414764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.416152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.424891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.428251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 331/657] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.429090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.448094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4b64e0-7a85-4547-96f0-5671bd39cdef None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.471284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.482699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.483523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.483845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.484130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.491308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.492859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-fc2d02a2-c179-44fd-8749-fa1fd0b11f0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:08.508732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:08.509847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:08.510910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 327/658] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:08.511482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138375-1894-49be-8ff6-e73f8741d8c4 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.511761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138375-1894-49be-8ff6-e73f8741d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.512034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3138375-1894-49be-8ff6-e73f8741d8c4 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.513394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 328/659] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:08.513953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138375-1894-49be-8ff6-e73f8741d8c4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.530738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d47d-2273-4f2d-9f87-495138323c32 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.564572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.565230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.565511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.565790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.566782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.567081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.568527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.587352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 332/660] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.588011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.618950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3138375-1894-49be-8ff6-e73f8741d8c4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.648753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.653122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.653778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.654057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.654331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.655211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.655514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.657004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.663347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 329/661] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.664239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.694286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf46751-cd6f-4138-8f6d-3fb1f8ecd235 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.714618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.735579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.736336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.736623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.736899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.745502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.747174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0578cb03-efcb-4ea8-8ad7-9ed4d7d150f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:08.764980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:08.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 333/662] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:08.767600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.768309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.768309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.780803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668603cd-6d6e-4227-8d8e-03227d344c19 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.786284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:08.787505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:08.820574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.821246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.821530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.821806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:08.822591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:08.822898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:08.824350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:08.837764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 330/663] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:08.838591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.866343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 334/664] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:08.866950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:08.933591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.952830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca12c664-9751-4e69-8937-d1495bf0c4ff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.960910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:08.987908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1d782-b717-441f-b5ef-ee8dca907b40 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:08.989863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:08.990972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:08.990972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:08.991160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.025016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.025712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.025970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.026239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.027062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:09.027365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.028835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.053166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 335/665] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:09.054012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.072780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.074545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.161115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557fceb-82c7-4587-bf09-544e2f93cd51 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.169712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.184155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 331/666] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:09.189566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.197246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.197892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.198565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.198844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.199271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.199725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=ed6cf63615e341518b142f986915e404) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:09.200201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.201928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.209124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 336/667] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/role_assignments?user.id=ed6cf63615e341518b142f986915e404&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:09.209947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.336707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208de5ec-b1fe-4149-a670-235790f3198d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.345209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3fe031-6d85-42f7-8fb9-bbcac3d86de6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.381247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.382054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.382337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.382614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.395191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:09.398000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.398663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.398951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.399232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:09.403764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:09.404717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:09.405570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 332/668] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:09.406811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.460262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.485016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.502748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.504307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.538336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194d871-bddc-4c4e-86d7-817c15d0357b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.585840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.586648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.586990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.587214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.602795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.604639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.621761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 337/669] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:09.627114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:09.628108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 333/670] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:09.629431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.629920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.730003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.751988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e6cda-1168-4e5d-8ce1-ec46552fcaf0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.771876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.774778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98facc07-65ad-453f-a88a-8c8cec5bd404 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.798675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.799943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.800886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.802032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.814022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.815017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.815517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.815943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.816851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.817790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:09.818285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.818515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.820055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.829275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 338/671] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:09.830368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:09.841138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:09.842064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:09.842928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:09.842928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:09.842928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:09.842928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:09.847296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 334/672] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:09.849424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:09.949209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d3867-c5a2-4f5d-876f-3456573c16d2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:09.981895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:09.987260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:09.988777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:09.989263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:09.989780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:09.990729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:09.991291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:09.993044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:09.995880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871c4db-e5f5-45f0-bd69-39b62bc14f9d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.007212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 339/673] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.008689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.052251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.053368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.053882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.054399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.065718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.067796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:10.086212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:10.087107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:10.088015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:10.088015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:10.088015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:10.088015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:10.090281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 335/674] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:10.091320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.123736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.133617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c30373-fc12-412a-a3a3-c56a0cb61732 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.171616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.172997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.173499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.173967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.174879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.175400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.177338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.190205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 340/675] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.191967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.234273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba090624-053e-4ccf-80fc-5a1234c66ad6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.251510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.277918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.279268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.279809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.280343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.288217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.290019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:10.306453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:10.307367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:10.308570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:10.310823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 336/676] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:10.313133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.317536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2732ef-5169-4959-a378-d845e3b6f308 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.359499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.360519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.361022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.361488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.362397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.362919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.365024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.377930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 341/677] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.380088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.416377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.439144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a89d62-d005-4b42-97de-68e100aa6a24 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.487639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.489581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.490653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.491158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.501988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.504246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e000948-9c68-48f5-8064-64c15c953cd0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.504781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.520121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:10.525659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:10.526530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:10.527469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:10.536848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 337/678] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:10.536848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.550917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.552032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.552573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.553113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.554218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.554734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.556469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.570272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 342/679] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.571436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.648544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654fb3e9-2207-467e-aaa4-8dec31030a5c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.682964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7934-9a36-4c24-a15d-228b17ada0c5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.684857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.685664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.685958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.686256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.694303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.695788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:10.714586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:10.715820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:10.716910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 338/680] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:10.717509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.720628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.725393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.726330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.726881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.727372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.728434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.729009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.730631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.750178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 343/681] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.751391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.785304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:10.839107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff49c9-4556-4b6f-a9e5-a06f4c210471 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.877649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46223b30-881a-4750-882b-85936afd57c0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:10.883443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.884136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.884418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.884692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.885510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=1f429ab936824983b32150cd5c181210) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.885819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.887225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.893228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 339/682] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/role_assignments?user.id=1f429ab936824983b32150cd5c181210&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.893988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.930060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:10.931292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.931762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.932459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.934027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:10.934757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:10.936473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070abeb-47e0-4719-bb79-bdca7ce4f52b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:10.963751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 344/683] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:10.966185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f2c-a861-4365-929a-ec261bb7b963 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:10.966628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f2c-a861-4365-929a-ec261bb7b963 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:10.967280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f54f2c-a861-4365-929a-ec261bb7b963 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:10.969802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 345/684] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:10.971085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54f2c-a861-4365-929a-ec261bb7b963 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:10.976830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.019145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507096-4587-4266-9fcc-f844e8aeaa7b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.076905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.077853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.078280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.078692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.079743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=509c7e7fcc7c4ef19c86f1ce27232d59) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:11.080060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.081498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca4b5c-1fba-445f-864d-ca667bea0642 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.088692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 340/685] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/role_assignments?user.id=509c7e7fcc7c4ef19c86f1ce27232d59&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:11.090020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.090320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.090606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.110150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.112229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:11.113259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:11.134698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f54f2c-a861-4365-929a-ec261bb7b963 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.193308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.193919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.194224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.194490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.209779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 341/686] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:11.258647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.297402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.299126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.350621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.395955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190739b2-1d1f-4593-9ace-54e0f48ca8c5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.413093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 346/687] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:11.415908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.420737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.439663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.440621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.441150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.441439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.452958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c702f9f9-37e6-42ff-91fc-2292ad1c7bab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:11.461282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:11.462231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:11.463115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:11.465287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 342/688] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:11.466930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e9a2-6767-4e44-ad01-1be18c790f7d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.467434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e9a2-6767-4e44-ad01-1be18c790f7d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.467999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf0e9a2-6767-4e44-ad01-1be18c790f7d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.469454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 343/689] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:11.470025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0e9a2-6767-4e44-ad01-1be18c790f7d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.533643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff1273-db28-4d7b-903a-38b0fbe9bdbb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.576107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.577617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.577910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.578476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.592487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf0e9a2-6767-4e44-ad01-1be18c790f7d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.593090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.594859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.616991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e823d071-2e4a-4d3d-a3af-6fd8f89e8117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:11.625052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:11.626908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:11.626908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:11.626908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:11.626908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:11.627642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 347/690] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:11.629403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.629787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.629978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.636729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.638358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.638711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.639058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.639916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:11.640290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.641727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.650811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:11.652309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 344/691] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:11.652709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:11.653339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.701278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.746957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 348/692] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:11.748132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.791740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f536773-fafd-4002-8fe5-42eb02542580 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.828251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.829255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.829755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.830250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.831182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:11.831906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.833514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.846540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 345/693] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:11.848392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.875871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a606572-e264-406e-99f2-d1083cb07ad7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.894150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:11.913122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:11.913821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:11.914107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:11.914386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:11.925320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:11.927535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:11.945417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:11.946307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:11.947191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:11.947191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:11.947191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:11.947191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:11.947191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 349/694] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:11.947955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:11.962393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd4dfc-5367-4f40-a1ea-c1874d2f0fc2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:11.973749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.001566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.002698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.003209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.003920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.016503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:12.047828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:12.049193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:12.050077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:12.050077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:12.050077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:12.050077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:12.053102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd604dba-f7e3-44de-a33a-3219f631fed7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.053348 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 346/695] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:12.054453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.094215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.095003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.096027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.096027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.103430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.105006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:12.119401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:12.120367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:12.121256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:12.125686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 350/696] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:12.126405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.165122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6c409-f645-41bc-8ca7-677ae3d198b7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.214660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.217510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.218504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.219069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.219593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.220533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:12.221068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.223673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.231987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf829cae-f3d0-46fa-a7f7-d1a72df7deb0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.237199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 347/697] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:12.238902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.268101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.268607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.268890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.269749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.270471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:12.270809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.272183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.289086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 351/698] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:12.289851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.355604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851973f0-18c6-450c-9c53-bc0024ec59ab None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.392526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b07b0f-b305-471e-ad0d-e7986e2751be None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.394129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.395683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.396182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.396702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.397704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:12.398215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.399971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.413885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 348/699] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:12.414951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.432241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.432669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.433733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.433848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.434205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.442730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.452114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:12.458831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:12.460097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:12.461019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 352/700] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:12.461596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.465094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.540547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bf02b-00d7-4f4c-a6e0-9556f32e7fdf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.563777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf43b4b-94ae-41c3-a900-59a6e3ac52e4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.582237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.583303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.583882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.584384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.585462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.587197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.599514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.600197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.600474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.600750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.601566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=064b2b59c734411e81c488d505deb560) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:12.601875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.603264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.615017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 353/701] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/role_assignments?user.id=064b2b59c734411e81c488d505deb560&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:12.616266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.694420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 349/702] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:51:12 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:12.697533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.745537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa09ca0-2702-47ec-8765-f0ade02856e3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:12.794398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:12.795016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:12.795358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:12.795669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:12.796609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:12.796926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:12.798662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f632e4d-2ad8-4047-b86c-3702353532d6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:12.824937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 354/703] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:12.830640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:12.931823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:12.967104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b6dd8-e2c0-4f22-a101-f36523484d05 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.002472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.003133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.003481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.004016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.080388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.082634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.156358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:13.189885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2bddb-1934-452a-8d0f-ffdabd3073b9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.190226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2bddb-1934-452a-8d0f-ffdabd3073b9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.190456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2bddb-1934-452a-8d0f-ffdabd3073b9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.194475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 350/705] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:13.195436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 355/705] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:13.200043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.203187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.203984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.203984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.231589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:13.232811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:13.353235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 356/706] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:51:13.366447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593a3b38-29f7-4911-b8ff-cc0abf7b64f4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.375356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.435800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.442562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.443118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.443643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.464660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:13.465629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.466933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:13.506009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:13.506974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:13.508484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:13.508484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:13.508484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:13.508484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:13.508484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 351/707] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:13.513116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.536171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8fdf75-a45b-42ac-8f66-6e29efeeb129 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.565293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:13.576197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.577465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.577857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.578456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.579718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.581277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-99d1d008-f9e1-40ae-99b2-aa16ad29eb70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:13.600258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:13.601426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:13.602289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:13.603110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 357/708] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:13.610363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11a9-4d47-4aff-b902-de3b7918ea01 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.610363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11a9-4d47-4aff-b902-de3b7918ea01 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.610363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f11a9-4d47-4aff-b902-de3b7918ea01 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.610363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 358/709] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:13.610363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f11a9-4d47-4aff-b902-de3b7918ea01 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.646093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed81ff5-ab36-4559-937f-3840958786a6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.688706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.689503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.689852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.690196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.691016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:13.691799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.693866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11435c-3e25-42d7-a27f-834294fba631 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.709668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 352/710] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:13.711328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.711709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.712057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.731493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:13.733051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:13.737109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f11a9-4d47-4aff-b902-de3b7918ea01 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.761560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:13.778978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.779666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.779955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.780237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.780939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:13.781244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.783070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.789289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 359/711] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:13.790503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.823671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 353/712] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:13.824883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.869101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:13.909052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3d316-e929-4ab4-8802-ab9600f6275f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.942398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daa1bc-590b-46e4-8aac-5a5041bef47f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:13.946205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.947004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.947286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.947576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.954750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.956219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:13.971191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:13.972944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:13.973949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 360/713] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:13.975017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:13.984161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:13.984161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:13.984161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:13.984161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:13.984885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:13.985029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:13.986446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:13.999733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 354/714] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:14.000789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:14.026746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:14.090511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5b654-330a-4dc7-9a04-83ca03980959 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:14.130339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:14.131056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:14.131336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:14.131637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:14.132393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:14.133848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:14.147468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:14.150010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:14.151801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 361/715] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:14.159535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:14.160753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:14.197025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f7dd8-3252-49e7-a9d0-eebcdb918cca None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:14.250535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:14.251216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:14.251503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:14.251878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:14.252692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:14.253042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:14.254599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:14.268179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 355/716] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:14.274634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:14.283591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b6f186-188e-437c-a1c0-ffd3c640cc7e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:14.296998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:14.350569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:14.351239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:14.351647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:14.351925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:14.352683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:14.353083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:14.354530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:14.360273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 362/717] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:14.368576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:14.440364 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dfac-b5b8-494d-bd1f-b1e924604887 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:14.479300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:14.480351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:14.480956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:14.481550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:14.482572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:14.483080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:14.484996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16536bab-557a-437e-8d8b-ec61ed8d08a5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:14.487136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09dee4c-8b29-43e3-932b-5db919cc44f0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:14.488725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:14.492662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 356/718] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:14 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:14.524490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:14.525180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:14.525464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:14.525736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:14.526461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] RBAC: Adding query filter params (type=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:14.526764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:14.528198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac44d3-9d53-4459-ba6c-e2f5bd4cca0f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:14.534836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 363/719] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:15.223431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0122b59-72c2-42f7-b123-316ed8e08d93 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.223979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0122b59-72c2-42f7-b123-316ed8e08d93 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.223979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0122b59-72c2-42f7-b123-316ed8e08d93 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.225661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 357/720] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:15.230688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.230985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.231268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.249003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:15.250184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:15.280964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:15.306032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7614-e481-4082-9f69-50e8f2c7e94b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.306681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7614-e481-4082-9f69-50e8f2c7e94b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.307178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b7614-e481-4082-9f69-50e8f2c7e94b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.309036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 358/721] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:15.314158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.314688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.315169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.320126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 364/722] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:15.335210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:15.336721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:15.355309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.410383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 359/723] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 05:51:15.434846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.544774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef120-ecc4-4474-ab06-969ff0e1e350 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.570503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f4196-7fba-4c9a-a6b2-f4f5d3273b3e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.577798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:15.584351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.585447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.585935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.586462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.598624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:15.607038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:15.607997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:15.608839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:15.615582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 360/724] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:15.618422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.652772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.657254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.657254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.657254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.681867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:15.696420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:15.697672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:15.698807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:15.701418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 365/725] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:15.707291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.734979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78fbda5-8b3c-439f-804f-e18fa4f65655 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.762807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:15.773803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.774730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.775179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.775665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.776626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:15.777308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:15.778796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:15.788254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 361/726] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:15.794834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:15.853677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:15.915667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c25406-18b9-4550-9ace-3962a4764f9b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.916151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa171-d9d6-4f54-9acd-1d8697cf28d1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:15.955657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.956917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.957202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.957501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:15.958713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:15.960113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:15.977173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:15.979432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:15.980604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:15.980897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:15.983046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 366/727] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:15.991333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.008901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.010379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:16.055897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:16.056795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:16.057664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:16.057664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:16.057664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:16.057664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:16.063987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 362/728] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:16.069703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.112559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.126531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995037c5-083e-41ab-9dd9-cf20bc0f5dd8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.174717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.176220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.176516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.176795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.199005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.200497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:16.246568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:16.248684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:16.250804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:16.250804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:16.250804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:16.250804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:16.250804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 367/729] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:16.253795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.330946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157c9fc-e408-4e8e-b694-1a23dde660f3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.344447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.416859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.417449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.417733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.418011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.418733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:16.419038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.420424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.424716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568230e4-cdce-4d6e-bcda-6b6beb32ca9c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.447060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 363/730] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:16.452534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.493470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.494134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.494415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.494695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.495412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:16.495746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.497105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.516902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.524661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 368/731] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:16.531758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.623138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a08ef1-1c7d-4219-9641-f95a306517b1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.678246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea330b7d-32b5-4fc1-845b-f20624913afd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.693356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.694222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.694519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.694798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.709029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.710529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.713668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.714493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.714768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.715041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.723234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.724686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:16.739952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:16.742170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:16.744564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:16.745892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:16.752514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:16.755426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:16.756797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 369/732] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:16.756972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 364/733] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:16.757120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.757270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.780986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.811325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:16.856095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e265d6-f5b5-472a-ae85-cb39bf272dc3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.862500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba0f4e9-8df6-4e37-a655-5e003376a1db None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:16.892072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.892831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.893254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.893595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.895390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:16.895785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.897395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433bb052-fc8c-4cdf-a780-0639b181080b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.900430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:16.901113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.901404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.901689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.902529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:16.902844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:16.904288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d636f38b-8a17-476a-9bf6-8354bb9f7c67 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:16.916574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 370/734] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:16.917946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832865-75ab-44b3-b9a2-043307223bf9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.918235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832865-75ab-44b3-b9a2-043307223bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.918508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71832865-75ab-44b3-b9a2-043307223bf9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.920014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 371/735] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:16.922038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71832865-75ab-44b3-b9a2-043307223bf9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:16.935838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 365/736] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:16.937313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:16.937613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:16.937922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:16.957362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:16.958567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.031028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71832865-75ab-44b3-b9a2-043307223bf9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.039735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 366/737] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:17.040669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.056210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.068791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.069445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.069728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.080740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.080876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.140597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.142058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.164164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd816771-85dc-4389-b335-ae5c7a0bb0e3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.198407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.198975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.199257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.199535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.241887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 372/738] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:17.242706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.260614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.267248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.268783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bd057-3c42-4826-a8b4-320c035416a5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.282106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.339150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b4fbf-ee91-46b6-9beb-255703b2a4dc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.367590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 367/739] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 05:51:17.368933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e3d4-77c8-4699-9479-9aaecaed248f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.369224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e3d4-77c8-4699-9479-9aaecaed248f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.369502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5184e3d4-77c8-4699-9479-9aaecaed248f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 368/740] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b0ed-5988-453c-bc64-0b26d49e4b60 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b0ed-5988-453c-bc64-0b26d49e4b60 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832b0ed-5988-453c-bc64-0b26d49e4b60 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 369/741] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:17.375110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832b0ed-5988-453c-bc64-0b26d49e4b60 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.376316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.376993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.377283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.377566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.378376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.380285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.478956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832b0ed-5988-453c-bc64-0b26d49e4b60 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.480172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 373/742] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:17 2022] POST /identity/v3/services => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:17.480989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.495204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.531994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.532941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.533231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.533517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.547344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.549184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d1180481-ff68-49f7-af3e-38124031e8b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:17.570023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:17.571147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:17.572164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:17.572164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:17.572164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:17.572164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:17.572447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.573909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 370/743] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:17.575360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.575850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.576285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.595050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:17.596611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.602613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f252-7edf-4ec1-84f9-551776bc75ba None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.642742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.643670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.644007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.644400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.655428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.656983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4a230c12-c605-4710-8784-a7009c22d57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:17.677521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:17.678502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:17.679372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:17.679372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:17.679372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:17.679372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:17.679372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 374/744] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:17.680110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.680274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.680552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.698416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:17.699617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:17.720381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 371/745] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:17.728180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.769888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 375/746] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 05:51:17.770763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.839643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.841111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:17.851463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46ab6a-34ae-45f2-9359-94927c07d4ab None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.882244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4a362-fcd0-484a-a14d-9f16af0178f2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:17.886855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.887524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.887837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.888113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.888829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:17.889134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.890552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.906109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 372/747] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:17.906109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:17.930353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:17.931024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:17.931538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:17.931841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:17.933175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:17.933462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:17.935385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:17.947927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 376/748] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:17.948750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.018257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9f807-c337-42f7-98e9-51f895adccb6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.059113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.059640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.059931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.060224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.060933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.062293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384df98-8907-41dc-b6bf-fb20d560c81d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.062397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.082767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.096575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.098014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.098292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.098566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.108838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:18.116362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:18.117312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:18.118180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 377/749] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:18.119666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.132352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 373/750] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:17 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:18.133449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.151938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.260319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204933bb-3887-4060-b69f-fa686d7eb865 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.277228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba68cb-4014-4eaf-b9f9-630fe3afec04 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.302863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.303632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.303926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.304228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.313570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.315018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.330642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.332087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.332571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.332854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:18.334596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:18.335445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:18.336974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 378/751] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:18.337612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.348483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.350490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:18.366325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:18.367238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:18.368564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 374/752] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:18.369038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.407986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.454937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.472488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efb1e6-55d6-4951-8428-c59fda754507 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.496014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c8721-ebf7-49ad-b2e2-03781e0f9d8f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.516183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9609-710f-4499-8e14-df261943819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.516860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9609-710f-4499-8e14-df261943819e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.517157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9609-710f-4499-8e14-df261943819e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.517418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9609-710f-4499-8e14-df261943819e None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.518173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9609-710f-4499-8e14-df261943819e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:18.518478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9609-710f-4499-8e14-df261943819e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.521150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9609-710f-4499-8e14-df261943819e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.533085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 379/753] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:18.533974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9609-710f-4499-8e14-df261943819e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.535385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.536351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.536897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.537450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.538512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:18.539035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.540701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.554340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 375/754] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:18.555504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.646776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9609-710f-4499-8e14-df261943819e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.648736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.674387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b876ac-eb98-4d8a-823f-961eb586306a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.695154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.695154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.695154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.695154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.695583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:18.695583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.695583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.703970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:18.713483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 380/755] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:18.713483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.717240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.718156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.719107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.719107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.731416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.733415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:18.754136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:18.755075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:18.756280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:18.756280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:18.756280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:18.756280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:18.758417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 376/756] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:18.759375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.832114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07202ce-f747-4094-a268-09399a30c844 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:18.870861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:18.871686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:18.872050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:18.872393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:18.873345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=b1dc332e02234697975d830116109efa) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:18.873718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:18.875239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:18.882793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 381/757] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/role_assignments?user.id=b1dc332e02234697975d830116109efa&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:18.883885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:18.917094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:19.001415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb629f7-a1db-45f8-9f0d-c205baffb86f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.004823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec646fb-1666-4eb6-bdbe-a8f95187caab None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.042794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.042794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.042794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.042794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.043208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:19.043208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.043902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.055867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.056942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.057427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.057914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.058952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=064b2b59c734411e81c488d505deb560) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:19.059515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.061267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.063422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 382/758] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:19.064870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:19.069430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 377/759] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:18 2022] GET /identity/v3/role_assignments?user.id=064b2b59c734411e81c488d505deb560&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:19.166039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:19.182940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c7422-2429-41fb-a635-c81e9f393734 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.221312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.222787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.223135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.223472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.232028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.233492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:19.249649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:19.250648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:19.251685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:19.255762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 383/760] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:19.257113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:19.313035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:19.392482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa515da0-5b3d-46ca-9e4f-c65c80d0bef3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.439172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.440230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.441322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.441810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.442850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:19.443359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.445027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.471508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 378/761] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:19.477897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:19.623304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f705-6caf-42f2-a825-cd58b895dcaf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.669717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.670883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.671393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.671885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.692738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.694130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.701105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-633388ec-67d9-426b-81cb-0afd99b8eec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:19.718138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:19.719056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:19.720593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:19.720593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:19.720593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:19.720593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:19.720593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 384/762] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:19.725531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:19.738055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2cd1-3815-410a-82fc-95707c6632b5 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.738351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2cd1-3815-410a-82fc-95707c6632b5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.738620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b2cd1-3815-410a-82fc-95707c6632b5 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.742503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 385/763] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:19.748035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.748327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.748607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.786024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:19.787219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:19.870263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:19.875849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b2221f-de62-4371-a1a4-9a1d641f3faf None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:19.914931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:19.915743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:19.916027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:19.916306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:19.917031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:19.917335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:19.918698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:19.931942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 379/764] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:19.936867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:19.961356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 386/765] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:20.045495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.078498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90bdf6-a875-425c-bca3-4b3c0570af9e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.117016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.117809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.118092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.118367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.125853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.127289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:20.153757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:20.154701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:20.156208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 380/766] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:20.161073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.224037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:20.248815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d8fa5-42b9-448f-b758-472c04d8e389 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.303915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:20.315154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.316047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.316515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.316800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.317458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.318833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:20.340976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:20.344556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:20.346558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 387/767] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:20.355791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.355971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc3e6c-5e2a-4376-89da-86434ad403f7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.432048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.432803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.432988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.433250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.434032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:20.434337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.435779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78230a3b-0060-4f16-be9f-ba5ecf20a25f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.451823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 381/768] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:20.453196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d087a-da5f-47c5-af8a-b730aeee7e7d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.453486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d087a-da5f-47c5-af8a-b730aeee7e7d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.453759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d087a-da5f-47c5-af8a-b730aeee7e7d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.455130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 382/769] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:20.456939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d087a-da5f-47c5-af8a-b730aeee7e7d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.510335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db37664-6a19-44df-baa6-26038939f640 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.558279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.559358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.559942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.560430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.561468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:20.561967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.563840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:20.564206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38050c2-92f6-4a60-bae2-4e0527adb29b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.571043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 388/770] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:20.572581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.573068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.573539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.589758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d087a-da5f-47c5-af8a-b730aeee7e7d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.591194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:20.592603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:20.627021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.627962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.628283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.628593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.630688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=53925cdf5a744200910943966d84ed40, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.632209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.653994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:20.671242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 389/771] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:20.680533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.703425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 383/772] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:20 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:20.704630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.846760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f0ac2-fd5f-4300-888a-714ba861b39a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.900643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b40f9-316d-4b95-a9fc-12c352a37c26 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:20.918179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.918859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.919143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.919416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.920549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:20.920859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.922800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.929505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 390/773] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:20.936544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.950015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:20.950869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:20.951152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:20.951422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] PATH_INFO: `/v3/services/network` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:20.952110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:20.953927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:20.971323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:20.973216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:20.974033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 384/774] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:20.979917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:20.986831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:21.008497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:21.117103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b299c63-e9d4-4018-9674-b2f60c6e9686 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.141269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a77b77-0fd5-4db9-b83d-53c000d900fb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.181352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.182424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.182914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.183394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.184362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.184645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] RBAC: Adding query filter params (name=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:21.185042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.185328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.185548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.185667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.186385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] RBAC: Adding query filter params (interface=public, service_id=ff67098257d748ad85e90af3971fda3d, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:21.186694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.187639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.188076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.193802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 385/775] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:21.201009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.201990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 391/776] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:20 2022] GET /identity/v3/endpoints?service_id=ff67098257d748ad85e90af3971fda3d&interface=public®ion_id=RegionOne => generated 194 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:21.216409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.285603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:21.324839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb931f6-7808-41f0-bc7f-87f1ac994810 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.367745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.369139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.369717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.370179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.371089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] RBAC: Adding query filter params (type=network) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:21.371594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.373258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.379583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 386/777] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:21.385986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.428853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044bab9-e1bb-4e15-a5fb-90797168dfe4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.446456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:21.468786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.469442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.469735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.470018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.470806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.472279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a541bdb8-e3be-4c21-81ec-ab0b28491c5c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.478558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 392/778] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/services => generated 772 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:21.483710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5148-f612-4ae5-8843-2781c1ed0eb1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.483710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5148-f612-4ae5-8843-2781c1ed0eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.483710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd5148-f612-4ae5-8843-2781c1ed0eb1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.486890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 393/779] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:21.488806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fdc6-c62d-4e40-8703-d67db5138220 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.489147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fdc6-c62d-4e40-8703-d67db5138220 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.489377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fdc6-c62d-4e40-8703-d67db5138220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.521131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-91d4fdc6-c62d-4e40-8703-d67db5138220 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:21.522479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91d4fdc6-c62d-4e40-8703-d67db5138220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:21.557293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca850694-7104-41c3-bcb0-f93433aebb01 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.637671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:21.642352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.643035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.643320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.643622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.647138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] RBAC: Adding query filter params (interface=public, service_id=3361576ca8424abb9acffda4cfcb2013, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:21.651474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.651474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.658232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 387/780] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/endpoints?service_id=3361576ca8424abb9acffda4cfcb2013&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:21.664179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.672834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 394/781] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:21.674986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232923-f7ba-4d0e-93b2-5c02bfdd441c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.675464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232923-f7ba-4d0e-93b2-5c02bfdd441c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.676007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35232923-f7ba-4d0e-93b2-5c02bfdd441c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.677412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 395/782] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:21.682680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.683026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.683313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.701824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:21.703022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:21.792792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7374c1-d226-4fc5-814b-838fe5bab9f3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:21.834160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:21.834834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:21.835117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:21.835391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:21.836899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:21.838055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:21.844435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 388/783] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/services => generated 772 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:21.845315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.914704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 396/784] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:21.954008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:21.966601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.035955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.067873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98cd6ea-db23-41cf-a9a3-f53047085995 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.105805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32399-793b-4a14-803f-1b52184872d6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.117070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.117904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.118192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.118472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.136170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:22.144980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:22.145893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:22.146701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:22.147327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.147423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 389/785] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:22.147493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.147763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.148040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.154151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.164598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:22.173932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:22.175486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:22.177293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 397/786] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:22.184557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.342271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.348426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22c68b-50a3-426f-85e4-96846df656e9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.373749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ced743-8025-4c94-9249-a5f3f2524b0e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.390957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.391665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.391951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.394025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.394999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:22.395309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.396725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.417407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.421660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 398/787] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:22.429424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.448209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.449361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.449843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.450377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.452385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:22.452955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.454635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.471125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 390/788] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:22.477943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.598271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c5213-c945-4538-b83f-8df16827d10e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.645990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20814f7c-bb96-40b7-98e4-896630dbeb49 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.666632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.667545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.667857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.668141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.692455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.693966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.694528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.695941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.696478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.696962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.725544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.727308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:22.730028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:22.730868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:22.731819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:22.731819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:22.731819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:22.731819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:22.737210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 399/789] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:22.743459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:22.753929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:22.755237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:22.756507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:22.756507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:22.756507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:22.756507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:22.759083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 391/790] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:22.764902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:22.785577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.806157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:22.882708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e4497-5571-4124-8289-7513387e5e69 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:22.923607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:22.924435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:22.925024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:22.925574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:22.926638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:22.927046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:22.928661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:22.942719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 392/791] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:22.948400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.067907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.076302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50132a-0e80-4467-a0d1-48e0d41ec31f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.088754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c6612-8dc1-40cf-b154-aec614dbb32a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.116257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.117209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.117592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.117963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.125333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.126859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.132807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.133632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.134207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.134747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.135642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.136101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.137577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43c9ca-cd9e-4bb3-b495-bfe5063c8a59 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-460f2281-49a6-4e63-bb98-a954f45dc62f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:23.143200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:23.144488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:23.145596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:23.147440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 393/792] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:23.148842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371253a6-ce55-47f1-ad5c-5ebdf5f92e2b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.151949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371253a6-ce55-47f1-ad5c-5ebdf5f92e2b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.152358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371253a6-ce55-47f1-ad5c-5ebdf5f92e2b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.157844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 394/793] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:23.157844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371253a6-ce55-47f1-ad5c-5ebdf5f92e2b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.158569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 400/794] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:23.160673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.161428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.161847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.183209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:23.184923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:23.271994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371253a6-ce55-47f1-ad5c-5ebdf5f92e2b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.286060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 401/795] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:23.286060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.288495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.325235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.325898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.326181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.326458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.327297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.327626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.329110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.350889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 395/796] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:23.356161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.371280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.428038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea878559-3f4e-48ce-bb16-ba7f35bfd2df None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.463900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb40954-eeba-40bb-a17a-849abdb8273c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.473982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.475409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.476288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.476710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.485360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.486864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:23.502497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:23.503845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:23.504897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:23.505956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 402/797] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:23.506809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.509067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.511360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.511864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.512343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.527266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:23.537599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:23.538521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:23.539335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:23.546004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 396/798] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:23.546004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.578352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.619962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba76f5-66e8-4b38-9dcf-227ea28c7295 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.627347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.658555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.660146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.660490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1b6b5-19d2-4ab7-bf2b-1da4fe92a431 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.660922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.660922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.671997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.674500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:23.695655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:23.696997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:23.697875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:23.697875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:23.697875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:23.697875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:23.700701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.701716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.701836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 403/799] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:23.702310 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.702604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.702986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.704063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.704568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.706939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.725917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 397/800] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:23.727064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.818458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e80cb-40a3-4144-a473-e62d8b14ee91 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.830503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea578f-1155-44ed-90ef-6925fb0b1aa8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:23.834193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.861795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.863120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.863467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.863774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.864534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.864843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.866453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.868671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:23.875177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:23.876145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:23.876625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:23.877094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:23.878032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:23.879155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:23.880756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:23.881966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 404/801] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:23.882890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.894460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 398/802] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:23.895939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:23.994642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0d3ca-0a34-4f05-b3e5-cde2734cd760 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.002376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26f135-03dd-4cc5-a3c5-0f2031991fd1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.044062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.044865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.045002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.045592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.045592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.045727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.045951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.046231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.057857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.058015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.059291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.059420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:24.076684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.077578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.078468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:24.078468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:24.078468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:24.078468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.078468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 399/803] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.079331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-82c35307-4cf3-4cae-aa1c-bc40d29f8369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:24.079869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.080706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.082150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:24.082150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:24.082150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:24.082150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:24.083834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 405/804] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.085328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d04d-634a-4d4a-91c6-5602341b16a5 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.085620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d04d-634a-4d4a-91c6-5602341b16a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.085903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7d04d-634a-4d4a-91c6-5602341b16a5 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.087422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 406/805] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:24.088171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7d04d-634a-4d4a-91c6-5602341b16a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.123991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.128923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.188333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc5dd2-a71a-4217-b335-6676ea581da0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.206905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7d04d-634a-4d4a-91c6-5602341b16a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.224674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.225481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.225763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.226042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.232691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.234126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.241820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.242548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.242908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.243256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.244090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:24.244401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.245749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f288ad7-03c9-44ce-bfd7-7d6a7cde41b6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:24.248771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.249731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.250638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 400/806] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.251131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.257437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 407/807] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:24.258689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd984a7-a2be-48c7-8ec9-edfaafad0a94 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.258965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd984a7-a2be-48c7-8ec9-edfaafad0a94 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.259251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd984a7-a2be-48c7-8ec9-edfaafad0a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.275754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6bd984a7-a2be-48c7-8ec9-edfaafad0a94 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:24.276946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6bd984a7-a2be-48c7-8ec9-edfaafad0a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:24.343391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 408/808] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:24.344668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bcae-b574-4494-9aba-55fa277d130f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.344960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bcae-b574-4494-9aba-55fa277d130f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.345242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32bcae-b574-4494-9aba-55fa277d130f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.346498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 409/809] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:24.347995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bcae-b574-4494-9aba-55fa277d130f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.365680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5435-66bc-4504-9aaf-03ff5a2cb326 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.367038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.373030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.400993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.401652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.401936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.402218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.402933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:24.403241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.404636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.416412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 401/810] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:24.417286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.470208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32bcae-b574-4494-9aba-55fa277d130f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.505178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.505833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.506120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.506406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.507182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:24.507493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.508925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89a4b-2f21-4484-b2dc-668bb90e20ab None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.514358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef9363-88e7-4830-acca-3c13b426013d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.521109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 410/811] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:24.522275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.522564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.522845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.538494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:24.539709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:24.552693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.553490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.553775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.554053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.561528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.562981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:24.577542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.578616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 402/812] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.579548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.605123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.610000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 411/813] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:24.610829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.629403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.681986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d09d5-eb41-489d-8a50-353001d0d246 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.715862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.716674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.716958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.717235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.717885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.718105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae370949-493f-4614-92db-3fc9ec24c5f3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.719243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.731429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.732457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:24.733280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 403/814] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.734973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.759991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.760785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.761068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.761341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.768029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.769491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:24.782949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:24.783879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:24.784744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 412/815] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:24.785775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.822679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.836935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe21338-197a-4059-a899-1237d3e7e983 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.850612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:24.872069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.872915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.873195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.873474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/b1dc332e02234697975d830116109efa/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.886387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ce5a3-9c24-4421-aafb-335e534406ba None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:24.888668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=b1dc332e02234697975d830116109efa, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.890106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.918585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:24.919246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:24.919527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:24.919829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:24.920655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:24.920960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:24.922616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:24.939358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 413/816] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:24.940226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:24.992904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 404/817] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:24 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/b1dc332e02234697975d830116109efa/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:25.000698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.068498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a4c59-21e1-4566-8cb6-64b53ff7941a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.102842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.107502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f26b-d298-418c-bd9e-ad2e16488737 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.112896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.113990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.114275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.114550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] PATH_INFO: `/v3/services/network` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.115209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.116756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:25.130146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:25.131173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:25.137640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 414/818] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:25.138473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.158646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.159539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.159888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.160167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.161022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:25.161325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.162697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.165472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.168965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 405/819] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:25.169776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.251684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b92e21-8e8e-460d-be25-d62c1b06ce91 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.275268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab75462-a54f-487b-a756-566ebda96582 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.290419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.291088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.291374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.291786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.292682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:25.292990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.294406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.311714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 415/820] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:25.312572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.314520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.315180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.316026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.316430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.368137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.387664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.389819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.391256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.422896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa4b6d-6d16-4390-9d0f-fd0d4f9687d7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.459542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.460237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.460527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.460806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.461516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:25.461827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.463189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.473425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 416/821] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:25.473425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.507011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 406/822] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:25.507011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.583276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e59071-8cfd-4b4e-83dc-d20307cc4be9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.597312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.605514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.608558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d8e0e-dcf5-4511-a19a-c485fbb809ec None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.617555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.618232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.618518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.618809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.619498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:25.619829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.621281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.631318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 417/823] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:25.631318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.650330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.651158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.651443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.651753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/064b2b59c734411e81c488d505deb560/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.653735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=064b2b59c734411e81c488d505deb560, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.655220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.723843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 407/824] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:25 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/064b2b59c734411e81c488d505deb560/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:25.725527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.742796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daecc69-fc17-4006-91d2-ef2c23b60a34 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.785307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.786013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.786304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.786592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.787694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] RBAC: Adding query filter params (type=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:25.788015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.789760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.797112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 418/825] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:25.798569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.855073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d194c8-0cb6-4a0d-bd2b-d317257c61b9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.861788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.898898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.899758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.900051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.900387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.915458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.917163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:25.936844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2af59-23af-46aa-85f1-b695ce9d7b81 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:25.942445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:25.943508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:25.944479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:25.944479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:25.944479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:25.944479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:25.944479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 408/826] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:25.944875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:25.959767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:25.983613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:25.984732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:25.985172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:25.986499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:25.988012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:25.989733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.064038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35a250-a30f-494e-9c0e-c08bb9ee7c66 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:26.114377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 419/827] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:26.114377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:26.133504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:26.136134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:26.137933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:26.138417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.139713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:26.143293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.234646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 409/828] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:26.266545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:26.271932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96d191-ba34-4b58-926c-5255b6d48ee1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:26.337132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:26.337835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:26.338121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:26.338400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.339146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:26.339514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:26.341255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.358366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 420/829] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:26.363811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:26.434483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:26.478833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc2c58-50ec-48ac-a780-35a626dd210d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:26.522634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432712-af84-471d-b20e-373f71828712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:26.523370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432712-af84-471d-b20e-373f71828712 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:26.523692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432712-af84-471d-b20e-373f71828712 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:26.523980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93432712-af84-471d-b20e-373f71828712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.532982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432712-af84-471d-b20e-373f71828712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:26.535157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93432712-af84-471d-b20e-373f71828712 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-93432712-af84-471d-b20e-373f71828712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:26.551278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:26.552411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:26.553419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 410/830] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:26.558531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:26.667438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80071b-5244-4cea-847a-0c7b56140670 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:26.703337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:26.704031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:26.704318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:26.704594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.705379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:26.705690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:26.707702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb688a3e-0f0a-4c86-a0b2-7e5f5d143672 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.723812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 421/831] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:26.726325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432712-af84-471d-b20e-373f71828712 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:26.830003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93432712-af84-471d-b20e-373f71828712 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:26.855817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:26.867926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:26.868592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:26.868881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:26.869163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:26.869996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:26.871746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:26.871845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0d5c5-f817-45b6-b4f1-21865d8055e9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:26.878299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 411/832] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:26 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:27.154742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df8ac-3430-4055-bcf7-5f4bf4dc6aac None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.155731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df8ac-3430-4055-bcf7-5f4bf4dc6aac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.156221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df8ac-3430-4055-bcf7-5f4bf4dc6aac None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.158061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 422/833] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:27.163177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.163478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.163795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.181625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:27.182834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:27.257338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 412/834] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:27.280825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df8ac-3430-4055-bcf7-5f4bf4dc6aac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:27.297746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:27.387928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df8ac-3430-4055-bcf7-5f4bf4dc6aac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:27.423039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:27.423787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.424078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.424353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.435694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:27.444075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:27.445020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:27.445849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 423/835] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:27.451663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:27.556826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6149b-1c86-4ea7-b329-4fe87b61588e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:27.583947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:27.594470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:27.595149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.595434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.595770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.596493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:27.596946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:27.598428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:27.607169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 413/836] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:27.612609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:27.697509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:27.723543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27769b-5d90-46ae-b92a-8d49d7d4ee29 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:27.759031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:27.759858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.760147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.760423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.771818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:27.773270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-489b6417-3e76-4e18-8d06-3ddeb150e82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:27.791329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:27.792268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:27.793181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:27.793181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:27.793181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:27.793181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:27.793181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 424/837] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:27.801202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:27.910190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc156a-a0c7-4010-8429-6516491df331 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:27.916090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1c1c-3f09-4c7c-834f-358bc8627acb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.916657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1c1c-3f09-4c7c-834f-358bc8627acb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.917142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb1c1c-3f09-4c7c-834f-358bc8627acb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.918962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 425/838] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:27.924398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.925566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.926087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.943582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:27.945077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:27.948119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:27.949458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:27.949747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:27.950028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:27.950752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:27.951063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:27.952453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:27.967750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 414/839] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:27.973138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.026267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.034052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 426/840] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:28.059352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.106572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4766ba-9c3c-447c-8b17-4f4927e6d4df None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.140969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.153639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.155012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.155736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.156576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.166403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a503-8b4d-4e23-9d8c-973fb3199511 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.167793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.170612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:28.193857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:28.194869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:28.196353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:28.196881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 415/841] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:28.200564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.212895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.213564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.213903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.214236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.226595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:28.234469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:28.235403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:28.236287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:28.241570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 427/842] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:28.242532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.314093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.318260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a725bf-9e2d-4c98-b582-2ef3dd13bc73 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.349004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e55e93-7d67-4ca6-8e00-f7e310a62079 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.354654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.355667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.356166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.356651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.357693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:28.358233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.359889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.367329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.380262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 416/843] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:28.389147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.390685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.391365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.391681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.391965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.392817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:28.393126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.394530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.407597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 428/844] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:28.410039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.519908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810211a5-df35-47e2-9228-9ed1d6fd80a0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.522896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3eb95-aea5-4865-adf8-2cdfeca6943c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.556525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.557465 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.557810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.558149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.558599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.558822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.558922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.559146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.569705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.571130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.589177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f1eed829-910e-467c-bd8e-349c18ce291f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:28.589584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:28.590427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:28.591304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:28.591304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:28.591304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:28.591304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:28.591304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 429/845] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:28.592314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956e49-2578-4daa-b7b5-5fc266721acc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.592421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956e49-2578-4daa-b7b5-5fc266721acc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.592623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38956e49-2578-4daa-b7b5-5fc266721acc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.594035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 430/846] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:28.599622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956e49-2578-4daa-b7b5-5fc266721acc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.633206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.639816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.641974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191dd81-0bf7-42ee-92cd-9c9c884f4daa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.714823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38956e49-2578-4daa-b7b5-5fc266721acc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.751026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 417/847] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:28.751026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.751026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.751026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.755648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.756400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.756687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.756964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.757687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:28.757991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.759355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.767430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:28.769577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:28.772391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 431/848] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:28.773137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.829840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.844585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 418/849] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:28.845729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.881130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:28.891279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87426b4d-40ec-4de9-bdf1-9e542915b170 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:28.927534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:28.928350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:28.928634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:28.928911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:28.939133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:28.940703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:28.958403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:28.959345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:28.960266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:28.960266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:28.960266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:28.960266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:28.960266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 432/850] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:28.960568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:28.967257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b85585-5604-4d2b-83a0-0375818f8d4e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.005586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.006553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.006838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.007115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.015472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.016960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:29.032311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:29.033259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 419/851] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:29.034909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.076902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83eb7-5f33-4ba9-abc8-ec9ebc85f8f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.090241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.114441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.115240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.115522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.115852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.116475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.118273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:29.131753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:29.132846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:29.133696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.137893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 433/852] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:29.138720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.148318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.149396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583877e2-8e16-4c32-a96b-f462dd059e15 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.184392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.185049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.185329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.185601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.186313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.186616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.188016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.200401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 420/853] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.201191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.247076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7662bd-b96e-49b1-a266-7afa0bcbc4e9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.279990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.280656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.280937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.281212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.282037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.282397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.283771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40220622-f2bf-4e29-950e-c6b1c5f8f2f4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.298927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef1164-2a74-4835-b558-ae26331f6c11 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.301846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 434/854] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.303090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab67f-7e89-43ac-a4f4-502a49445635 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.303382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab67f-7e89-43ac-a4f4-502a49445635 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.303680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cab67f-7e89-43ac-a4f4-502a49445635 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.304901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 435/855] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:29.305582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cab67f-7e89-43ac-a4f4-502a49445635 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.311689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.337687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.338360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.338712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.338933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.339701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.339975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.341388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.347267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 421/856] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.348003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.369289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.407622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cab67f-7e89-43ac-a4f4-502a49445635 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.442247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.443042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.443326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.443630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.445645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156248a-bcda-4a21-b3d3-0aefe9896243 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.450146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.451591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c8fef581-4675-402a-873e-692dc8cf9c08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:29.465565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:29.466609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.467620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 436/857] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:29.469795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.470082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.470361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.482670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.483322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.483711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.483998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.486773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:29.488306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:29.525273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.551780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.553153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.554702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 437/858] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:29.555579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.612182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.657190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aa6b8-08a8-4fa5-bfbb-90797ae8feec None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.661013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 422/859] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:29.661844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.691958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.692626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.692918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.693199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.693898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.694207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.695581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.699994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 438/860] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.700765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.750118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.785771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c54351-f5e1-47b9-9b95-1a6d216f5703 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.812598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28aa1-fd5b-49ee-a14c-0414e4e30216 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.825647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.826477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.826762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.827038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.827863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:29.828175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.829645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.833634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.843719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 423/861] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:29.844749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.861434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.863413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.863413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.863413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.863942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:29.865440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:29.879739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:29.880954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:29.882055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 439/862] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:29.883063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:29.954648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47fbee-c43e-4363-9707-8117ad76adaa None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:29.985926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:29.991305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:29.992129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:29.992414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:29.992698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:29.997870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2defd-169d-48e4-9359-9c37d57a52cd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.004011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.005517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:30.024745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:30.025859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 424/863] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:30.026770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.048930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.049593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.050404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.050675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.051507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=b1dc332e02234697975d830116109efa) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.051843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.053254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.063808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 440/864] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:29 2022] GET /identity/v3/role_assignments?user.id=b1dc332e02234697975d830116109efa&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:30.066457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.125299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.154440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46157d-05e3-40fa-b188-6bb3d461118f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.186156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34fc28-3d34-4453-8708-cc102fe8a7a9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.203191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.204191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.204481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.204760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.205653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.206001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.207849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.214717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 425/865] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:30.220477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.226126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.226805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.227092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.227373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.228141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.228452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.229841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.250974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 441/866] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:30.253697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.282052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.351359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a0d4-38c2-43b1-a203-82cd69130964 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.389906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.390298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b4365-e379-468f-99cf-e6f05a541935 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.390586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.390872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.391153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.391909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.392219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.393728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.399041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 426/867] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:30.406884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.442061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.442899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.443185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.443469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.457995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.459518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:30.477303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:30.478253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:30.479131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 442/868] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:30.485032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.611025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250cde4-e506-4aec-a4e7-618b8c7ad437 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.625427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:30.650012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.650694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.650984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.651270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.652101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.652418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.653865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539940df-4089-428b-869b-5e3fb346c0ae None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.668369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 427/869] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:30.675542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:30.793276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e40b0-9b81-4703-8b3d-3ad880abf742 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:30.829912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:30.830579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:30.830871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:30.831186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:30.832046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=064b2b59c734411e81c488d505deb560) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:30.832364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:30.833796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6904f0d-adf4-4f5b-834e-2596a27bf8ec None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:30.840398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 443/870] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:30 2022] GET /identity/v3/role_assignments?user.id=064b2b59c734411e81c488d505deb560&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:31.845118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130043f-35b1-4982-95ca-42a015e59f0c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:31.846157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130043f-35b1-4982-95ca-42a015e59f0c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:31.847269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130043f-35b1-4982-95ca-42a015e59f0c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:31.849172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 428/871] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:31.854236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c919-bbb6-4867-a087-545322d740cf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:31.854648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c919-bbb6-4867-a087-545322d740cf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:31.854819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12c919-bbb6-4867-a087-545322d740cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:31.872294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4d12c919-bbb6-4867-a087-545322d740cf None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:31.873619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4d12c919-bbb6-4867-a087-545322d740cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:31.900016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:31.947568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 444/872] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:31.970494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130043f-35b1-4982-95ca-42a015e59f0c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:32.078694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130043f-35b1-4982-95ca-42a015e59f0c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:32.113868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:32.114457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.114738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.115015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.115768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:32.117118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f77d1-faed-4cb2-a219-5b2a1b8ec554 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:32.213062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 429/873] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:31 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:32.351366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb3e35-daa1-4dab-93de-768bb64964d6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.351728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb3e35-daa1-4dab-93de-768bb64964d6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.351966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb3e35-daa1-4dab-93de-768bb64964d6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.353639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 445/874] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:32.359377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e50d-8e56-4ced-9b5a-76198c69a9e8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.359695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e50d-8e56-4ced-9b5a-76198c69a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.359975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13e50d-8e56-4ced-9b5a-76198c69a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.377919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1f13e50d-8e56-4ced-9b5a-76198c69a9e8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:32.379123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1f13e50d-8e56-4ced-9b5a-76198c69a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:32.407036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:32.458883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 430/875] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:32.482633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb3e35-daa1-4dab-93de-768bb64964d6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:32.600058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb3e35-daa1-4dab-93de-768bb64964d6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:32.624075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e1bb3-f308-4575-b535-579005b7a478 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.624522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e1bb3-f308-4575-b535-579005b7a478 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.624809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e1bb3-f308-4575-b535-579005b7a478 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.628451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 431/876] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:32.632928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.633213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.633492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.637790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:32.638619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.638908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.639189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.650444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:32.650898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:32.652133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:32.658685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:32.661600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:32.663632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 446/877] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:51:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:32.671591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:32.696123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:32.723626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 432/878] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:32.747363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:32.799152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad693c87-c9c8-4867-8ead-aadd92a72911 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:32.843896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:32.848922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50837-e521-4077-9546-bb99424e917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:32.850043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50837-e521-4077-9546-bb99424e917b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.850635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50837-e521-4077-9546-bb99424e917b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.851400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee50837-e521-4077-9546-bb99424e917b None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.852604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee50837-e521-4077-9546-bb99424e917b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:32.853080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee50837-e521-4077-9546-bb99424e917b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:32.855299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee50837-e521-4077-9546-bb99424e917b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:32.857059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a571065-c443-4c2e-b6bd-0f90ed5d0d16 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:32.870722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 447/879] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:51:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:32.871789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50837-e521-4077-9546-bb99424e917b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:32.908334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:32.910166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:32.910915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:32.911427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:32.912395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:32.913810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e297b0-6ec6-45db-a3b0-ad3b021791c9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:32.966008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:32.984600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee50837-e521-4077-9546-bb99424e917b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.004781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 433/880] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:32 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:33.013243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206850-e972-4d50-bde5-6649e938b60d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.013599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206850-e972-4d50-bde5-6649e938b60d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.013850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29206850-e972-4d50-bde5-6649e938b60d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.019607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 434/881] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:33.024670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.025388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.025891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.043925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.044857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.045151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.045437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.060994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:33.061538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.062293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:33.063649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:33.090767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:33.092229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:33.093181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:33.093181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:33.093181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:33.093181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:33.093181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 448/882] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:33.099487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.165138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 435/883] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:33.188653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.232380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d500605d-0f11-423c-9f85-bc8dfa4ee5c9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.272890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:33.279801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.280526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:33.281754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.282169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.282457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.283193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:33.283696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.290481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.306065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 449/884] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:33.306244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791549d6-466e-44ff-92c3-57d792e4d7ea None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.308162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.355487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.355487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.355487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.355487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.356277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.358477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:33.375423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:33.376480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:33.377314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 436/885] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:33.383093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.457850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d630d-5c64-4e4a-895c-5bb394ebbfcf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.493513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27454d-9e28-4bd5-b8f5-da5eeae8ad93 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.505083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.506593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.507211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.508036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.519177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.521429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.530152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.530873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.531234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.531629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.532450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:33.532832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.534993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:33.542630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:33.543604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:33.544545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:33.545657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 437/886] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:33.546574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.552925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 450/887] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:33.554430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.560431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:33.620421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:33.660092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa93ff-76bf-4ec6-86b0-8327ff0ebc51 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.689634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a0159-dab2-4e09-b26a-45827b616a31 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.707817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.708814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.709520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.709985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.711309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:33.711824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.713375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.720526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 438/888] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:33.741866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.742569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.742909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.743197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.744100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:33.744417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:33.745893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:33.768419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 451/889] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:33.774445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:33.853898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:33.887350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61971eb-934e-4cfd-bd7a-99a6c3eff6b3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:33.927245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:33.927931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:33.928220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:33.928501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:33.999598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.001052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.079702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.117638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 439/890] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:34.119261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.230059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cde517-34ad-4f92-96a0-5bad2a34ea3a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.240039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.268146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.269647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.269936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.270216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.280733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.282181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bbe8ba5e-d385-4162-ad5b-e1d6c5c6f138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:34.301358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:34.302273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:34.303160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:34.303160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:34.303160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:34.303160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:34.303160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 452/891] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:34.309716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.358245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7ed5-dc43-491e-814a-de05f2c992a4 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.358570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7ed5-dc43-491e-814a-de05f2c992a4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.358816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef7ed5-dc43-491e-814a-de05f2c992a4 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.360478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 453/892] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:34.365700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.365985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.366267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.387484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:34.389121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:34.427606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f121d7-5c1f-4f8f-947f-4d4ed43639e3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.463781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 454/893] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:34.475440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.476389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.476918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.477452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.478376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:34.478884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.480513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.487070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.494126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 440/894] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:34.499681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.532576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.585168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.595411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ea47-8446-4459-89ad-84b5d2f664b5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.609117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba0c4-de00-4571-b96f-07a9c2d49c27 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.633270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.634199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.634491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.634773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.635434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.636945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:34.651012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:34.652065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:34.652889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:34.657433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 455/895] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:34.658291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.661010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.662076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.662575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.662921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.670611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.672469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:34.687009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:34.688037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:34.688914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:34.693376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 441/896] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:34.694409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.792421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba81b04-1571-4b44-87fd-350c4c64f745 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.799420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.810311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891d7de-f45d-4ebb-9254-5952eb1f5375 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.841223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.842713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.843288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.843819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.844714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:34.845208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.847376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.847829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:34.848567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:34.848934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:34.849211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:34.850274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:34.850435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:34.851972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:34.859125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 456/897] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:34.860658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.874438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 442/898] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:34.875533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:34.882566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:34.975018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcabc6d-8f6c-4239-97a6-f7e7b5514c12 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:34.984290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51982fe2-af23-4076-8dad-a0afe99c0417 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.014571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.015767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.016284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.016790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.017735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:35.018451 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.020658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.021170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.021859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.022147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.022425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.023478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] RBAC: Adding query filter params (role.id=92e957cc2db94efb80b06e2b8e77ec0e, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=b1dc332e02234697975d830116109efa) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:35.023732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.025216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff18f41-4510-446c-bd9b-362b7819d902 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.034796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 457/900] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:35.040055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 443/900] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:34 2022] GET /identity/v3/role_assignments?user.id=b1dc332e02234697975d830116109efa&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=92e957cc2db94efb80b06e2b8e77ec0e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:35.041518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.121898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1115a9-30a4-4d32-9d77-aceac704be36 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.122243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1115a9-30a4-4d32-9d77-aceac704be36 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.122463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1115a9-30a4-4d32-9d77-aceac704be36 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.127508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 444/901] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:35.130565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.130794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.131064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.143914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:35.148495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:35.149707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:35.162874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:35.168697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498c9e6-ee9a-4f47-8892-0897d701868e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.209686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.210752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.211226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.211739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.213602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] RBAC: Adding query filter params (interface=public, service_id=cd80c7527be74212b4c6872712f939a7, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:35.214113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.215666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.223647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 458/902] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/endpoints?service_id=cd80c7527be74212b4c6872712f939a7&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:35.227543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.247688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 445/903] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:35.273311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.361273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b430fe-6194-4776-a5c7-d8c2700e5bbd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.400995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.401472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.401760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.402038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.402725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.404136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.408550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7b73-9b5a-4482-9c2c-71c841151708 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.411590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 459/904] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:35.462537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.463849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.464315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.464753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.465581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.467168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:35.482413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:35.484751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:35.486687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:35.495701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 446/905] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:35.497870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.517326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:35.634639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95da39-d97a-45ff-aa74-445449bee970 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.673368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.674045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.674337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.674670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.675470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:35.675950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.677449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.682962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 460/906] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:35.689767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.703481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:35.821668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e076d-76dc-49d2-803f-e170a3f51e27 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:35.869967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:35.870900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:35.871187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:35.871466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:35.872208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:35.872532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:35.873881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:35.887782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 447/907] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:35.890944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:35.993629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:36.033933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9472442-44da-4278-a58c-31995009c7a2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.073125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.073864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.074153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.074434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.075291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] RBAC: Adding query filter params (interface=public, service_id=1335506bb1de470e9e2c68c53a56daba, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:36.075641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.077018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3acb164-4c22-42e8-991e-64fd6468f4e4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.084165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 461/908] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:35 2022] GET /identity/v3/endpoints?service_id=1335506bb1de470e9e2c68c53a56daba&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:36.091904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.106685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2240-3f9b-4fb4-a9fe-b5609f8da538 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.107056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2240-3f9b-4fb4-a9fe-b5609f8da538 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.107539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc2240-3f9b-4fb4-a9fe-b5609f8da538 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.109409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 462/909] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:36.114847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.115333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.115497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.135398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:36.137445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:36.197455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:36.235152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97b837-3839-4fa1-b891-ebf230c4ab05 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.239641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 463/910] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:36.261345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:36.280083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.281158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.281650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.282223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.283219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.285516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce0153-89f9-4ad7-bf1a-8e10ac9efdcb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.292664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 448/911] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:36 2022] GET /identity/v3/services => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:36.339413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:36.377248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad671a-1560-4b47-bca2-a8ce52e518d1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:36.416192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:36.416871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:36.417156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:36.417430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:36.418173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:36.419583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ccba0-4794-4b83-8b8e-c6cc0db250d3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:36.584373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 464/912] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:36 2022] POST /identity/v3/services => generated 241 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:37.246886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781e57-65ce-435c-8178-4a5773e3b96a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.247946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781e57-65ce-435c-8178-4a5773e3b96a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.248454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02781e57-65ce-435c-8178-4a5773e3b96a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.250343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 449/913] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:37.256080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.256920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.257420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.275107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:37.276884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.354336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 465/914] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:37.377623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02781e57-65ce-435c-8178-4a5773e3b96a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.490063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02781e57-65ce-435c-8178-4a5773e3b96a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.526656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.527530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.527860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.528142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.530912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.540002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0416c224-3322-4fa9-ab32-80d1fb7bd84a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:37.548588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:37.559110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:37.560037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 450/915] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:37.560797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.613749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934dc7-6ba4-4074-b508-d3160d6f1150 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.614054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934dc7-6ba4-4074-b508-d3160d6f1150 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.614245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71934dc7-6ba4-4074-b508-d3160d6f1150 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.615940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 451/916] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:37.619472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.621237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.621632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.622017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.642063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:37.644942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:37.666483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea443c1-c808-409c-b17f-6759f20282dd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.710786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.711717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.712117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.712472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.713452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:37.713841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.715291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.725403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 466/917] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:37.735590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 452/918] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:37.736802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.753253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.850413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16971cfb-8e0e-4481-b881-ad0c3dc3776a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.862827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb7963-8994-4afa-9dad-2bbee29e3c43 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:37.868362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.890103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.891232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:37.892096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.892549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.892934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.900787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:37.902409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:37.902699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:37.902976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:37.903959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.905337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.905456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:37.907080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:37.918201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:37.919247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:37.920287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 453/919] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:37.925871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:37.927766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:37.928740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:37.928740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:37.928740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:37.928740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:37.928740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 467/920] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:37.930701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:37.933372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.049808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0968d976-e0e0-4e34-a0c7-224259080dc8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.055701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3187911-59ef-4399-8bcf-54cb9848e914 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.088384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.089217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.089597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.089983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.090852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:38.091257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.092794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.094068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.095097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.095746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.096205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.097130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:38.097630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.099179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.104731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 454/921] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:38.106102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 468/922] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:38.115742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.115941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.142527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.173099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.223171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65296f9a-817c-4d1f-9201-dba1a4925e2f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.224800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b7f6d-bf83-44e9-b61b-9762f5b952b8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.261117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.262382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.262817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.263261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.263936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.264624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:38.264966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.265263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.265428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.265805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.267098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.277680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.277680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.278698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 455/923] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:38.279865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:38.294188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:38.295217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:38.296194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 469/924] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:38.301837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.392354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b9d2-4b9c-4e1c-8d5d-bdb8afee3fd5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.401262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.411579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.414393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8679f5-03d7-4c6e-8cf7-00085d03b7f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.429183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.429855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.430140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.430424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.431283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.432607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef573ea4-f3ac-4477-84be-e8bec2f18209 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.449936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.450605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.450886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.451163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.452024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:38.452330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.453780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721254bc-5dd4-4f20-94ad-ffe35c08020e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.473056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 470/925] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:38.474326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394606-92cb-4a54-bc59-81204eceeeae None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.474616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394606-92cb-4a54-bc59-81204eceeeae None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.474892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab394606-92cb-4a54-bc59-81204eceeeae None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.476244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 471/926] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:38.478571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394606-92cb-4a54-bc59-81204eceeeae None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.527584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 456/927] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:38.527584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.527584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.527584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.551472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:38.553081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:38.594201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab394606-92cb-4a54-bc59-81204eceeeae None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.634309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.635225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.635515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.635828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.648684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.656375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.656513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 457/928] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:38.660655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:38.670926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:38.672212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:38.673679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:38.673679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:38.673679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:38.673679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:38.673679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 472/929] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:38.678752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.682317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.808924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965d5e5-a26f-4647-ae81-cbbfeb04c09e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.820187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35d2b-1e3e-473c-9b25-1f21c5c15f48 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:38.823782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.845525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.846882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.847160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.847434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.848114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.849547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.861099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:38.861771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-655a9b94-7d6b-471a-80a0-0f4d73856f41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:38.861968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:38.863629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 05:51:38.864551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:38.865336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.865336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.865336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:38.865336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:38.865593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81e33-850b-4b83-abaa-a25a178f165b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:38.868503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 473/930] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:38.869841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f859-492d-4b3f-b731-2d625103e144 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.871849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f859-492d-4b3f-b731-2d625103e144 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.871849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3f859-492d-4b3f-b731-2d625103e144 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.872348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 474/931] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:38.873120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f859-492d-4b3f-b731-2d625103e144 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.886267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 458/932] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:38.886267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:38.886267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:38.886267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:38.902258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:38.903459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:38.941690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:38.975461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 459/933] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:38.976629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:38.995239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3f859-492d-4b3f-b731-2d625103e144 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.035062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.035847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.036138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.036423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.037136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:39.037448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.038816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.044347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 475/934] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:39.045241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.101868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.108917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99dfd2-2545-46b3-a6ee-7f7a5cb08ed3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.145299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.146105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.146388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.146668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.153481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.154918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.155077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c54aa6-c74f-4645-8951-3e29fce5e968 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:39.168975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:39.169928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:39.170859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 460/935] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:39.171370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.184922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.199282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.199282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.199282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.199282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.199709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.200662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:39.213255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:39.214277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:39.215362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 476/936] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:39.216211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.284685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c73d2b-1e52-4c9c-99b4-219ed267da01 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.320474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.321156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.321446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.321729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.322444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:39.322754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.324166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.329244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 461/937] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:39.329862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.341553 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c66e0f-c3a1-40a4-8afd-db3f5414c4fa None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.355126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.382176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.383175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.383689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.384163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.385118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:39.385620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.387212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.401698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 477/938] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:39.402752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.442160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61c9f0-f86c-45c5-8429-7ad0d63aae00 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.464080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.477278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.477954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.478238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.478520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.479223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:39.479534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.480923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.485644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 462/939] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:39.486440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.526399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7b311-3825-49e1-8c01-8460eb490b30 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.563297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.564101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.564500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.564794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.565561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.567059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.571103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.588739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9524-302e-4bc1-9d01-7b793f8c84ab None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.622808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.623834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.624124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.624399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/b1dc332e02234697975d830116109efa/roles/92e957cc2db94efb80b06e2b8e77ec0e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.626588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=b1dc332e02234697975d830116109efa, role_id=92e957cc2db94efb80b06e2b8e77ec0e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.628077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.668754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 478/940] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:39.669722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.706061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 463/941] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:39 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/b1dc332e02234697975d830116109efa/roles/92e957cc2db94efb80b06e2b8e77ec0e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:51:39.807912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:39.814489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4000d8-9e14-48ed-975b-dc3a7f986fd4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:39.857188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:39.857884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:39.858235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:39.858529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:39.859219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:39.859522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:39.860964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:39.868487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 479/942] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:39.874551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:39.983940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04361395-fe0f-4bfc-b066-0809378a005e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:40.020120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:40.021201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:40.021694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:40.022178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:40.023170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] RBAC: Adding query filter params (interface=public, service_id=47be2eaedb9b4c38a629c216d403ec0d, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:40.023730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:40.025297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3cb54-b4fd-4e07-b3ac-f56db9925aaf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:40.037738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 464/943] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:39 2022] GET /identity/v3/endpoints?service_id=47be2eaedb9b4c38a629c216d403ec0d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:40.045863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:40.152284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d78f68-0504-4d5d-bf1a-919c88c5d120 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:40.190890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:40.191833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:40.192119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:40.192396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:40.193073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:40.194426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e5e69-a415-40a4-b07c-42c7b4d046cb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:40.200963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 480/944] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:40 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:40.679628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0970eb-b5c2-4119-92c4-a134ff8c61e9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:40.680527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0970eb-b5c2-4119-92c4-a134ff8c61e9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:40.680818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0970eb-b5c2-4119-92c4-a134ff8c61e9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:40.682333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 465/945] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:40.687748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:40.688557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:40.689039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:40.707025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:40.708545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:40.733735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:40.782640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 481/946] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:40.806429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0970eb-b5c2-4119-92c4-a134ff8c61e9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:40.815814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:40.916134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0970eb-b5c2-4119-92c4-a134ff8c61e9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:40.953668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:40.954278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:40.954567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:40.954851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:40.955688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:40.957186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:40.958612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING keystone.server.flask.common [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 05:51:41.010789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.sql.core [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:51:41.010789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 05:51:41.010789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [parameters: {'id': 'f5cd469b0ab84e76b5d1b9f0bd7c74ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 05:51:41.010789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80338) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5cd469b0ab84e76b5d1b9f0bd7c74ec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5cd469b0ab84e76b5d1b9f0bd7c74ec. Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:51:41.029153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 05:51:41.030026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application yield resource Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise self.value Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application session.commit() Jul 25 05:51:41.031121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:51:41.032054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:51:41.032961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application result.read() Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:51:41.033961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [parameters: {'id': 'f5cd469b0ab84e76b5d1b9f0bd7c74ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:41.034980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:41.037217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f5cd469b0ab84e76b5d1b9f0bd7c74ec. Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:41.039394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 466/947] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Jul 25 05:51:40 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:41.048530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:41.152730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23c206-8934-4f31-9a80-eeea193c0cfe None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:41.187729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:41.188805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.189382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.190405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.197544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:41.199211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-410e338e-cccd-48a3-95fa-f51721e30065 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:41.213499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:41.214360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:41.215320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:41.217705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 482/948] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:41.224593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:41.296065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:41.333003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0362918-1af3-4063-a5d4-01d7f4a79359 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:41.369127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:41.370267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.370267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.370459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.371091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:41.371402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:41.373060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4465370e-ced7-4f97-a211-154945c800c6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:41.398043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 467/949] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:41.858214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f9cc-a7cb-472d-95b9-8ce34a3379fe None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.859233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f9cc-a7cb-472d-95b9-8ce34a3379fe None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.859788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371f9cc-a7cb-472d-95b9-8ce34a3379fe None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.861616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 483/950] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:41.867516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.868372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.868864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.887022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:41.888895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:41.950316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289005-be77-4e51-ae30-fb1e7b3659cb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.950946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289005-be77-4e51-ae30-fb1e7b3659cb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.951432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d289005-be77-4e51-ae30-fb1e7b3659cb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.954369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 484/951] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:41.959771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:41.960313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:41.960790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:41.961000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 468/952] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:41.983768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:41.987981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:41.990470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:42.004448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.055530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.079095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 485/953] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:42.103542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.113665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eea088-edc1-4321-84ef-5d4d5664fbce None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.160337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.161446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.161911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.162868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.163970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.165770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:42.183413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:42.184719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:42.185749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:42.188853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 469/954] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:42.199425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.223128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780487f-d015-45f5-8fc0-448e77f64414 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.268930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.270685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.271173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.271884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.287416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:42.298093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:42.299288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:42.300918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:42.302668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 486/955] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:42.309618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.324704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.328488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f8eab-b911-424d-b82b-68b70100ec56 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.351899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.375946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.376834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.377281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.378180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.378795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:42.379104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.380506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dea7ab-697a-4175-a325-d0a351cec68c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.385262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 470/956] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:42.386677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319e1a-06a8-4db5-b9ab-d3f5e02b7f65 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.387154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319e1a-06a8-4db5-b9ab-d3f5e02b7f65 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.387632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319e1a-06a8-4db5-b9ab-d3f5e02b7f65 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.389467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 471/957] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:42.391520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319e1a-06a8-4db5-b9ab-d3f5e02b7f65 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.432541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6ed8e-4b5f-422b-a421-9499c2c8fd6e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.470239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.470658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.470949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.471340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.472117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:42.472432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.473809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aefab5-7467-44e1-b661-9f6203dd7bf6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.486446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 487/958] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:42.486446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.486446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.486446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.502094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:42.504054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:42.510996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319e1a-06a8-4db5-b9ab-d3f5e02b7f65 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.555606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.555606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.555606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.555606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.556052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:42.556052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.556052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.567766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 472/959] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:42.569779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.579989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.588117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 488/960] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:42.616664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.635659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.702677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b727a93-061c-4d96-a08c-e62c8318eb4a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.750768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.751612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.751887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.752164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.759218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab691e1-ba2d-444a-8b2d-8300a76587a9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.767905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.770697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:42.795538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:42.796560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:42.797727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:42.797727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:42.797727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:42.797727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:42.797956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.797956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.798111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.798656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.798971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.805199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.805332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 473/961] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:42.805935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:42.817212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:42.818249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:42.819096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 489/962] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:42.824688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:42.890907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.934039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:42.941224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838c319-822a-4540-9970-8af55de0fcbb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.947943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694e9c11-dc4b-49ad-a4b1-1a05ef566036 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:42.985173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.986204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.986655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.988043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.989137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:42.989614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.990191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:42.990965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:42.991343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:42.991684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:42.991799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:42.992646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:42.993102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:42.995006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.010416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 490/964] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:43.010416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.010833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 474/964] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:43.011916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.138989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f98de9-5801-4ed5-8712-723e6f696b16 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.149925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff218df9-df54-40f4-89d9-8b01453cc8ce None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.178000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.178820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.179107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.179385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.187109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:43.187883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.189135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.199733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.200612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.203235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.203235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.203235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:43.203235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.204136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:43.207424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:43.208521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 25 05:51:43.209458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:43.210193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 491/965] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:43.212087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 475/966] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:43.215378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.224599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.254571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:43.341183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b3657-cebb-46c9-bd77-ef5b2dfc8ce4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.342837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5808e-5718-4f7f-906e-70f103a1c423 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.380214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.381243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.381751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.382251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.383286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:43.383661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.384071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.384326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.384619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.384899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.385650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.386618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.386991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c7b75-85c7-4ef6-bae6-5d5da6176677 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.406178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 476/967] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:43.412114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.475983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 492/968] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:43.503714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:43.537804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3944-6ea3-410e-98df-e51eea9977a2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.556427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727bb2-0d46-47f5-9d10-44f3acfae043 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.556822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727bb2-0d46-47f5-9d10-44f3acfae043 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.556995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9727bb2-0d46-47f5-9d10-44f3acfae043 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.562575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 493/969] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:43.564406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.564840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.565129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.583241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:43.584691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:43.592240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.593902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.594403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.594927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.637175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:43.671266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 494/970] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:43.695182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.696911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.697212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.782839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:43.825007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c091b6-1588-4978-8b3e-b3ada4b91785 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.831721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 477/971] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:51:43.839612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.866620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:43.867248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:43.867536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:43.867860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:43.868560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:43.870342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:43.871678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING keystone.server.flask.common [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 05:51:43.914157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.sql.core [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:51:43.914157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 05:51:43.914157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [parameters: {'user_id': 'aedf07efbbaa4c618c7223139bfa17f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 05:51:43.914157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80337) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result.read() Jul 25 05:51:43.929034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:51:43.930064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application yield resource Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application next(self.gen) Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise self.value Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application session.commit() Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 05:51:43.931014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.session.flush() Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application compat.raise_( Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 05:51:43.931952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 05:51:43.932881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application conn.query(q) Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application result.read() Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 05:51:43.933738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [parameters: {'user_id': 'aedf07efbbaa4c618c7223139bfa17f5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:43.935941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 05:51:43.937859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 495/972] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jul 25 05:51:43 2022] POST /identity/v3/users => generated 160 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:43.940736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:43.962841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b48f9a-bc79-4e55-919b-7eda73eb5b51 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:43.986134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.000651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.001846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.002970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.003470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.016914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.019025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:44.051802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:44.052690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:44.053587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:44.053587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:44.053587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:44.053587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:44.060227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 478/973] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:44.060356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13468e6-f6b2-4b03-9d87-dc6ddc3ba5f7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.061428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.087036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.100194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.100791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.101075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.106895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.109711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.111348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:44.128050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:44.129064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:44.130826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 496/974] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:44.136677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.176971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cbf20-6dc3-49dd-a294-cf997ec659b7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.214122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.215133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.215677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.216167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.217095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:44.217606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.219183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.236285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 479/975] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:44.238098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.247402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.252158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7782-bbd3-4609-8405-ca3aae3c952f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.291238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.291967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.292255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.292536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.293459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:44.293772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.295297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.328559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.344869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 497/976] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jul 25 05:51:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:44.349256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bf66f-c980-434d-aa2f-832afa1184c4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.390293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.391305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.391731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.392118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.401134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.402804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:44.418420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:44.419581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:44.420680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:44.422801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 480/977] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:44.471987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.558380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636d0e4-3746-488f-82d6-d0f93b56638d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.597566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.598592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.599082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.599636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.600628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:44.601136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.602842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688a4200-a340-424b-9f10-1212dda106f4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.616103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 498/978] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:44.624404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.719676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3398-9810-400c-ae72-9a1a9ff37f56 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.720055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3398-9810-400c-ae72-9a1a9ff37f56 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.720439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3398-9810-400c-ae72-9a1a9ff37f56 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.722711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 499/979] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:44.727838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0caad-32f1-4ab7-9a54-0cb24a1645e8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.728242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0caad-32f1-4ab7-9a54-0cb24a1645e8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.729034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0caad-32f1-4ab7-9a54-0cb24a1645e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.742486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87379659-6935-40fe-b55b-b11ece55ed08 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.746437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9ad0caad-32f1-4ab7-9a54-0cb24a1645e8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:44.748108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9ad0caad-32f1-4ab7-9a54-0cb24a1645e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:44.759479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.777008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:44.777678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:44.777963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:44.782223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:44.782223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] RBAC: Adding query filter params (role.id=92e957cc2db94efb80b06e2b8e77ec0e, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=b1dc332e02234697975d830116109efa) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:44.782223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:44.782223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:44.799799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 481/980] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:44 2022] GET /identity/v3/role_assignments?user.id=b1dc332e02234697975d830116109efa&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=92e957cc2db94efb80b06e2b8e77ec0e => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:44.830303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 500/981] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:44.854006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:44.865060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:44.964895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656e77d-7421-4202-b2b0-665aa25306f1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:44.999689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:45.000355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:45.000644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:45.000922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:45.001652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:45.003168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227795b-5225-443d-84d9-ce0d73e89f98 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:45.078544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 482/982] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:44 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:45.628744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef85f-12b5-4b9a-95d0-abe41def7c11 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:45.629266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef85f-12b5-4b9a-95d0-abe41def7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:45.629344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aef85f-12b5-4b9a-95d0-abe41def7c11 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:45.630832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 501/983] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:45.636074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:45.636374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:45.636663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:45.654361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:45.655543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:45.715477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:45.735580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 483/984] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:45.755860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aef85f-12b5-4b9a-95d0-abe41def7c11 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:45.859229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aef85f-12b5-4b9a-95d0-abe41def7c11 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:45.893755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:45.894479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:45.894785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:45.895062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:45.895739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:45.897101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:45.909107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:45.910130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:45.916237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 502/985] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:45.918760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.020869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9659a-9b20-44eb-8939-ef3cfe503eb9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.061617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.062287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.062568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.062843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.063542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:46.063883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.065322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.074917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 484/986] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:46.076197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.090229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:46.178330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb53c37-3221-4e12-8e69-43c5937b1fcf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.213320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.213993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.214281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.214562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.215266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:46.215593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.216956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.222662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 503/987] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:46.228288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.285768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:46.332065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80c594-501c-4b90-80f0-8bdde0e1cc74 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.366016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.366678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.366964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.367242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.368093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] RBAC: Adding query filter params (interface=admin, service_id=47be2eaedb9b4c38a629c216d403ec0d, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:46.368406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.369769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58f317b-bb14-42a3-a612-f2aac7562098 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.380311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 485/988] 10.222.0.36 () {56 vars in 1249 bytes} [Mon Jul 25 05:51:46 2022] GET /identity/v3/endpoints?service_id=47be2eaedb9b4c38a629c216d403ec0d&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:46.381482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:46.459005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:46.483749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398b164-9997-47a2-893f-2690f3d2ec60 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:46.517455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:46.518815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.519171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.519476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.520186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:46.521555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7635-2730-411b-b0c2-02dfa773a06e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:46.535594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 504/989] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:46 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 05:51:46.880637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cd64-56b0-46ea-b301-88d4a7b68e1e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.881036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cd64-56b0-46ea-b301-88d4a7b68e1e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.881215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cd64-56b0-46ea-b301-88d4a7b68e1e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.882740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 486/990] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:46.887797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adc2a-a2c6-40d1-ba89-e7098a148528 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:46.888252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adc2a-a2c6-40d1-ba89-e7098a148528 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:46.888439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205adc2a-a2c6-40d1-ba89-e7098a148528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:46.905617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-205adc2a-a2c6-40d1-ba89-e7098a148528 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:46.906803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-205adc2a-a2c6-40d1-ba89-e7098a148528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:46.979650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 505/991] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:46.996782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51cd64-56b0-46ea-b301-88d4a7b68e1e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.111306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51cd64-56b0-46ea-b301-88d4a7b68e1e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.133527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.144252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201266b-a289-488c-b998-d3ee41a87583 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.144551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201266b-a289-488c-b998-d3ee41a87583 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.154943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201266b-a289-488c-b998-d3ee41a87583 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.154943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 506/992] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:47.155139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.155139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.155139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.155139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] PATH_INFO: `/v3/services/image` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.155437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.155506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.155506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.155506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.155730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:47.165631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:47.166710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:47.173365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 487/993] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jul 25 05:51:46 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:47.174447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:47.174447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:47.174610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.239452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.245554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 507/994] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:47.268851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.285250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6256d1-03a7-4592-96b5-7f498ffbad6a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.322188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.323141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.323669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.324159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.324945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] RBAC: Adding query filter params (name=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:47.325282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.326623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.331813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 488/995] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:47.337127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.371260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a8b9a-1633-4f53-b4c4-d71e85c6267a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.386749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.407319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.408151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.408520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.408780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.409431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.410804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:47.422955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:47.424691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:47.425723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 508/996] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:47.430729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.443275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfbe512-7607-4275-a511-b385fedcd369 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.478047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.478718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.479008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.479288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.480028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] RBAC: Adding query filter params (type=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:47.480343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.481701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.495583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 489/997] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:47.496584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.541492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03361b94-5069-403b-94e6-7597ab124614 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.578081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.578768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.579055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.579331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.580082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:47.580927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.582325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.587977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 509/998] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:47.593814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.705524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a9b21-4c52-4e52-a43a-3f84c85baf7e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.718874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.749370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.750047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.750335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.750616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.751327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:47.751666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.753191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.762932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 490/999] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:47.764170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:47.863670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dbe86b-ed86-420c-a34a-cd414257a661 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:47.888225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:47.897730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:47.898391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:47.898675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:47.898951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:47.899752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] RBAC: Adding query filter params (interface=public, service_id=3a1cb3eb54f84abbaecb863aef31418e, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:47.900063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:47.901407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b1ab0-b0ee-40c4-aa80-000c2e15f007 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:47.911374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 510/1000] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/endpoints?service_id=3a1cb3eb54f84abbaecb863aef31418e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:47.912782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.017699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d3a39-fa76-42dd-842a-281134795890 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.061414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.062093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.062381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.062663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.063345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.064820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb283daf-6ec7-470b-98f1-9860f241911e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.075600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 491/1001] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:47 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:48.587814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619e92-ecbb-4655-8f39-0b7183765e73 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.588168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619e92-ecbb-4655-8f39-0b7183765e73 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.588395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45619e92-ecbb-4655-8f39-0b7183765e73 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.589817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 511/1002] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:48.595050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.595488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.595697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.614518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:48.615786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:48.653940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:48.687180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 492/1003] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:48.711665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45619e92-ecbb-4655-8f39-0b7183765e73 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.816042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45619e92-ecbb-4655-8f39-0b7183765e73 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:48.848910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:48.849649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:48.849935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:48.850212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:48.850861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:48.852240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:48.864694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:48.865883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:48.866892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 512/1004] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:48.872064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:48.970160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088063b-4ca9-4720-9cc1-6371f0348a0e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:49.005312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:49.006056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.006342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.006620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.007320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:49.007651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:49.009017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:49.014008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 493/1005] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:49.019806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:49.086272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:49.132513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332cc9a-a119-4081-a847-868aa9cf397e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:49.166556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:49.167225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.167508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.167819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.168518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:49.168827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:49.170183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ee6751-f44a-4a57-be38-e2eb8fc48c6c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:49.176139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 513/1006] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jul 25 05:51:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:49.181697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:49.218477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:49.285284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53e4fd-f7ee-4f24-841e-74add6e8a341 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:49.320246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:49.320904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.321193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.321473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.322214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:49.323604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c29ab4-35a4-4a94-b94a-b7200ef3a467 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:49.387782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 494/1007] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:49.543285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989367-446a-4ff6-8851-9c85f3c21060 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.543586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989367-446a-4ff6-8851-9c85f3c21060 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.543877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4989367-446a-4ff6-8851-9c85f3c21060 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.545381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 514/1008] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:49.551238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849d59-0380-4fcb-bee9-a3c892f747d1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.551655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849d59-0380-4fcb-bee9-a3c892f747d1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.551946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3849d59-0380-4fcb-bee9-a3c892f747d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.569885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f3849d59-0380-4fcb-bee9-a3c892f747d1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:49.571107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f3849d59-0380-4fcb-bee9-a3c892f747d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:49.648272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 495/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:49 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:49.671226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989367-446a-4ff6-8851-9c85f3c21060 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:49.778587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4989367-446a-4ff6-8851-9c85f3c21060 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:49.795739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:49.814364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:49.815792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:49.816083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:49.816423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:49.817157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:49.818523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442ca9b-a9a0-40ab-960d-af01ae832a0e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:49.896025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 515/1010] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:49 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:50.140861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d5e0-9888-4e40-82c9-70131f758727 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.141219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d5e0-9888-4e40-82c9-70131f758727 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.141433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d5e0-9888-4e40-82c9-70131f758727 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.144073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 496/1011] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:50.149067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.149540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.149714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.166603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:50.167818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:50.244651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 516/1012] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:50 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:50.268217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d5e0-9888-4e40-82c9-70131f758727 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:50.291324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:50.373014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d5e0-9888-4e40-82c9-70131f758727 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:50.407888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:50.409622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.410112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.410600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] PATH_INFO: `/v3/services/compute` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.411452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:50.412971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:50.425110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:50.426283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 05:51:50.427299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:50.429830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 497/1013] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:50.435537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:50.541768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef5667-0fc8-4d62-9678-9969699896f8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:50.544255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:50.577213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:50.578524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.579061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.579344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.580086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:50.581056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:50.582459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:50.587529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 517/1014] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:50.592973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:50.683014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:50.699604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4184b-432a-4199-916e-0032d88d9aff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:50.735451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:50.736245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.737123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.737614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.738325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:50.738637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:50.740056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4601e5e-4953-453f-b998-9d29ac58ad54 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:50.749495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 498/1015] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jul 25 05:51:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:50.750688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:50.849937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25de22-5818-4b3c-94a7-86d86f6f08b8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:50.883931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:50.884590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:50.884871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:50.885143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:50.885876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:50.887211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a598de-3ef4-47d2-8704-346100e0d0ba None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:50.995448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 518/1016] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:51.443678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01eecb-9031-494d-87ce-3eb63403f121 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.443977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01eecb-9031-494d-87ce-3eb63403f121 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.444177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01eecb-9031-494d-87ce-3eb63403f121 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.445698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 499/1017] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:51.450878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.451312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.451473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.468804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:51.469990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:51.489788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:51.545884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 519/1018] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:51.570469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01eecb-9031-494d-87ce-3eb63403f121 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:51.673999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01eecb-9031-494d-87ce-3eb63403f121 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:51.707763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:51.708491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.708773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.709052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.710230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:51.711685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7579aad8-8d46-4719-80e6-4ff57154e1ba None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:51.718120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 500/1019] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:51.719261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:51.819790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbba61-6284-401f-a5a7-8f7a19925bee None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:51.854485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:51.855148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.855433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.855738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.856444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:51.857863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5d47e4-6940-4bf1-b075-7c45ad90bc1d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:51.935589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 520/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:51:51 2022] POST /identity/v3/projects => generated 311 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:51:51.975380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9bf4a-11c2-4985-b7df-736a9a3c92dc None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.975719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9bf4a-11c2-4985-b7df-736a9a3c92dc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.975907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9bf4a-11c2-4985-b7df-736a9a3c92dc None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.977548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 501/1021] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:51.983240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:51.983929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:51.984481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:51.990505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:52.003740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:52.005101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:52.089618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 521/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:52.113368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9bf4a-11c2-4985-b7df-736a9a3c92dc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.132549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:52.222122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9bf4a-11c2-4985-b7df-736a9a3c92dc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.256082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.256881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.257169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.257451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] PATH_INFO: `/v3/services/image` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.258096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.259461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:52.271036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:52.272029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:52.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:52.274205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 502/1023] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:52.278603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.380192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc84e4c-e5f2-48b4-8d80-9f47c228bb22 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.409923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:52.415382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.416073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.416354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.416626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.417317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:52.417616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.418972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.424142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 522/1024] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:52.440219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.511587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:52.530411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca814-50ff-4396-9d46-92ffae04d02e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.564675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.565339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.565621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.565897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.566592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] RBAC: Adding query filter params (type=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:52.566898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.568283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.573283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 503/1025] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:52.579071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.679012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc07c8-554d-47e8-803c-e8803c93b5b1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.713585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.714240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.714523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.714798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.715636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] RBAC: Adding query filter params (interface=public, service_id=e08247c29ebf4361aaf6852b734aaab2, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:52.715949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.717295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91266f1-3152-4ee9-8bac-6f8ef8b0faba None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.727926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 523/1026] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/endpoints?service_id=e08247c29ebf4361aaf6852b734aaab2&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:52.729276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:52.832251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bbf78-9fd4-4f4a-b37c-e74cbe29f28d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:52.866822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:52.867489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:52.867804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:52.868088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:52.868793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:52.870152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ed269-84d6-44d7-8ef0-116ad9011099 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:52.876878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 504/1027] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:51:52 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:51:53.148130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b694-cb91-4f61-8d5d-da08a42cf8a8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.148440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b694-cb91-4f61-8d5d-da08a42cf8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.148630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2b694-cb91-4f61-8d5d-da08a42cf8a8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.150170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 524/1028] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:53.155198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.155593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.155928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.173417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:53.175228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:53.177616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.243202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 505/1029] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:53.266038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2b694-cb91-4f61-8d5d-da08a42cf8a8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:53.329399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.373653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2b694-cb91-4f61-8d5d-da08a42cf8a8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:53.407969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:53.409307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.409592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.409872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.420023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:53.428446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:53.429376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:53.430219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 525/1030] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:53.437456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:53.539427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232602bf-34dd-4aa1-b2c8-e060e3841623 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:53.574012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:53.574686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.574973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.575252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.576023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:53.576335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:53.577698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:53.583871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.592283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 506/1031] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:53.593856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:53.699908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02bcda-b2dd-4311-a83a-32a011947401 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:53.720022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:53.735087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:53.735921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.736208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.737230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.747521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:53.748990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:53.766160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:53.767228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:53.768336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:53.768336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:53.768336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:53.768336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:53.775320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 526/1032] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:53.776302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:53.878552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd7f054-e7f0-49fd-bd8a-c69e4ba672ea None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:53.912655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:53.913325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:53.913612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:53.913889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:53.914608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:53.914917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:53.916303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa717b-23ef-4e6a-9223-291a9465bebf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:53.933700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 507/1033] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:53.935417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.045590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b013-a0a9-46b9-b566-96553f28b636 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.052284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d285-4058-40d2-829a-2250380867c7 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.052826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d285-4058-40d2-829a-2250380867c7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.053321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d285-4058-40d2-829a-2250380867c7 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.054903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 508/1034] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:54.059887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.060389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.060862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.077652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:54.079584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:54.082871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.083640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.083932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.084208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.094727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.097006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:54.111788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:54.112897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:54.113847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:54.115105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 527/1035] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:54.118719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.149244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.151408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.165971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 509/1036] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:54.191079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.225494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b032b-385c-4363-b45d-3d0ecaeb0534 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.262048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.262713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.263029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.263309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.264170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:54.264478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.265896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.284649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 528/1037] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:54.289988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.294799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f702f00-c83a-4e88-a787-4b1c28fa9b17 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.329250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.330636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.330924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.331200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.332415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.333880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.335488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 510/1038] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:54.341085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.388331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.398983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665538c6-362d-459d-bfc3-09a982b2a027 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.403115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.434678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.435334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.435650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.435946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.447139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e8832-8de6-46ef-8d45-6cf017b937aa None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.481919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.482845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.483286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.483735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.484594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.486200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.504659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.506101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.576608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 511/1039] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:51:54 2022] POST /identity/v3/users => generated 285 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:54.599737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.613508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 529/1040] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:51:54.619598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.736263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f599e-4346-4ad1-9c28-600e1ed0bf9e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.753008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:54.773753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.774556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.774842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.775131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.786626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.788142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d985f0e4-262b-4807-993d-8748d4371c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:54.806403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:54.807537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:54.809133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:54.809133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:54.809133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:54.809133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:54.809133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 512/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:54.813716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.918223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee88981-1fcd-49c6-9cc9-f36abce0dca7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:54.952292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:54.952959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.953250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.953534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.954259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:54.954571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:54.956653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:54.968235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 530/1042] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:54.971600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa4c3c-9b1d-4c11-9241-9c85f718cfe9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.971600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa4c3c-9b1d-4c11-9241-9c85f718cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.971600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa4c3c-9b1d-4c11-9241-9c85f718cfe9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.972960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 513/1043] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:54.976735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:54.977743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:54.978040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:54.978325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:54.995059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:54.996342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:55.038234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:55.071319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 514/1044] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:55.094165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8bb9b-207a-4c93-be29-9c6c6a48fd8f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.094791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.131032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.131875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.132165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.132449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.139366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.140849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:55.157139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:55.158831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:55.160143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 531/1045] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:55.164950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.204006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:55.210427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74040fb-6abe-4051-80e9-8ffa4f4e2110 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.245405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.246205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.246486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.246767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] PATH_INFO: `/v3/services/image` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.247413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.248923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:55.262184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:55.263185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:55.264480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 515/1046] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jul 25 05:51:55 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:55.269848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.278920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c104bb6-7232-485a-b035-a8f5e4a1c120 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.291952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:55.317195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.318026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.318314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.318597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.319384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:55.319733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.321286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.334761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 532/1047] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:55.340330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.385500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d781857-139b-40ec-82d8-ac60c225d80c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.426278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.426940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.427230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.427495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.428253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] RBAC: Adding query filter params (name=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:55.428520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.429871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.435092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 516/1048] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:55.441498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.444492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb338b5-3a7f-4220-812a-1e8d2c89ef5c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.466793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:55.481727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.482383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.482670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.482945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.483790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] RBAC: Adding query filter params (role.id=92e957cc2db94efb80b06e2b8e77ec0e, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:55.484101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.485511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.503939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 533/1049] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:55 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=92e957cc2db94efb80b06e2b8e77ec0e => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:55.550855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c307f0a-a563-42f8-8742-1ff647179f2f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.588426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.589105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.589388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.589663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.590370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] RBAC: Adding query filter params (type=image) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:55.590672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.592079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781ac19-781e-4618-b317-2854fdcff315 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.602892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 517/1050] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:55.603994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:55.643120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:55.709306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db18474-b848-4edd-a283-63e8c8fd3774 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:55.743249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:55.743939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:55.744220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:55.744494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:55.745247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:55.746582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330c9eb-066b-4d4f-a7c3-97e12c7f25a5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:55.852179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 534/1051] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:51:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:51:56.726224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5ca4-050e-4920-9da0-2add7954ea95 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:56.726795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5ca4-050e-4920-9da0-2add7954ea95 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:56.726795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f5ca4-050e-4920-9da0-2add7954ea95 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:56.728322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 518/1052] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:56.733340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:56.733720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:56.733911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:56.750952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:56.752786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:56.827505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 535/1053] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:51:56.850403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f5ca4-050e-4920-9da0-2add7954ea95 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:56.939194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:56.953379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f5ca4-050e-4920-9da0-2add7954ea95 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:56.989884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:56.990713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:56.991002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:56.991282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.004081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:57.011933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:57.012861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:57.019197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 519/1054] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:57.021577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.045182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.129996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c9475-63c5-4b0f-bb2f-f08f8e97a7f0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.165055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.165966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.166399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.166852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.167769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:57.168235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:57.169736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:57.178909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 536/1055] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:57.184587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.286336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbecba-a154-4bd5-b5ea-3e2a801281a3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.319066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.319975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.320262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.320541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] PATH_INFO: `/v3/users/61e2afccbddd4b17aaba26f25826a9b1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.335251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] RBAC: Authorizing `identity:get_user(user_id=61e2afccbddd4b17aaba26f25826a9b1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:57.336748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67d4e7-c62e-4ca8-8f6e-004b27f996d8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:57.338633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 520/1056] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/users/61e2afccbddd4b17aaba26f25826a9b1 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:57.344175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.426520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.448993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1f9af-d8b1-46a7-b59a-6d08b505356d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.483090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.483772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.484062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.484342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.553416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b9e6-d646-4709-ad9f-2886e123352b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.553623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b9e6-d646-4709-ad9f-2886e123352b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.553905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b9e6-d646-4709-ad9f-2886e123352b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.555273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 521/1057] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:51:57.557849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:57.559337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:57.560338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.560631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.560914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.571940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.579058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:57.580408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:57.640941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.668303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 537/1059] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:51:57.668483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 522/1059] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:57.669503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.677126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.777567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b306e-c40f-489b-826a-35900d597ab7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.787336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1336c1-8023-4ec4-80df-44631711f98e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.813923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.816101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.816393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.816672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.817864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:57.819284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:57.821019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 538/1060] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:57.826922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.831027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.832538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.832824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.833107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.836286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.844443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:51:57.854164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:57.855259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:57.856155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 523/1061] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:57.861328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:57.879917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:57.936450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54eaaa-74d7-4a3e-b1e4-2260842d7266 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.967662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a26eeb-3275-4dcb-8ea2-826c271ac580 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:57.970314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:57.971841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.972127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.972405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.973238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=7c73a3f2413b42289097ca70689339b3, user.id=61e2afccbddd4b17aaba26f25826a9b1) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:57.973551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:57.974973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c9bf6-7f59-48a9-8b2f-38d03c08a30a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:57.982679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 539/1062] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/role_assignments?user.id=61e2afccbddd4b17aaba26f25826a9b1&scope.project.id=7c73a3f2413b42289097ca70689339b3&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:57.982679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec89f-aefa-4380-9db3-cd60ce5499cc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.982679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec89f-aefa-4380-9db3-cd60ce5499cc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.982679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec89f-aefa-4380-9db3-cd60ce5499cc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:57.983784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 540/1063] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:51:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:51:57.990121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:57.990414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:57.990695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.008850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.009395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:51:58.009597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.009837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.010121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.010632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:51:58.010887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:58.011201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.012656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.027537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 524/1064] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:51:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:58.029146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.101542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.120014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 541/1065] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:51:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:51:58.141052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.183522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0edb5-c99c-4ac2-9ce4-b50d30688f1d None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.196413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.227948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.229405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.229925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.230541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.244715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.247271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.265420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3448700-39de-4709-aa81-2d011c51aec5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:58.267586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:58.268978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:58.269974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:58.269974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:58.269974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:58.269974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:58.272462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 525/1066] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:58.280677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.321671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.322339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.322632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.322911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.409331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d061d4-1eb6-4b2c-91a3-04b7717304e3 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.420507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.422259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.424855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.452825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.453850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.454396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.454786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.456814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:58.457387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.459131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.477709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.486142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 526/1067] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:58.491702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.554948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 542/1068] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:51:58.560421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.597917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b1093-aba2-41fb-929e-be766977f9bb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.632529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.633329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.633617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.633900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.641509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.646084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:51:58.659000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:58.660239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:58.661252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 527/1069] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:58.666006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.672166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33390190-1e77-480d-97ad-300bca1fb113 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.700349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.712593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.713394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.713708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.713988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.723729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.725965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.727512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:58.745037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:58.745959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 543/1070] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:58.752314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.782845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e20585-2cf1-43c5-8552-cd86e0b217ac None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.819810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.820512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.820826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.821113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.821955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:58.822268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.823715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.848762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 528/1071] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:58.850026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:58.861655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d56ae03-18aa-4e85-a628-e0606f9986cf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:58.897491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:58.898151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:58.898435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:58.898716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:58.899431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:58.899770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:58.901116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:58.912535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 544/1072] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:51:58.958790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:58.973176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479852c2-0bc0-4f75-8353-1c24c8185c99 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:59.011418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:59.012269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:59.012560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:59.012840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:59.024469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:59.025974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:51:59.048567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:59.049575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:59.050703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:51:59.050703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:51:59.050703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:51:59.050703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:59.050703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 529/1073] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:51:59.055869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:59.124210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:59.175119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327c8a8-51ed-4378-bd8d-ab8cd65a050c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:59.212452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:59.213119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:59.213407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:59.213684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:59.214404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:59.214714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:59.216118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:59.228683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 545/1074] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:59.234444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:59.332519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac1781-6b33-4d6c-b92f-ef1a49a37866 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:59.365501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:59.366282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:59.366570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:59.366852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:59.373403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:59.374839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:59.377337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:51:59.390036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:51:59.398756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:51:59.399996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 530/1075] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:51:59.400558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:59.497784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798ebb-b6a8-41d3-8fe0-a9268d29b75f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:59.510933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:51:59.532146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:59.532809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:59.533893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:59.534186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:59.534971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:51:59.535283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:59.536745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff0334-ac35-4341-af90-81ee69eedd94 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:59.548813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 546/1076] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:51:59.554755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:51:59.653100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5dd7c-4601-4b3c-819e-30602c3f7bb9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:51:59.686596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:51:59.687500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:51:59.687828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:51:59.688105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/92e957cc2db94efb80b06e2b8e77ec0e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:51:59.690870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=53925cdf5a744200910943966d84ed40, role_id=92e957cc2db94efb80b06e2b8e77ec0e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:51:59.692340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2522e8-c1f9-49d1-94b2-40dc332a5400 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:51:59.782076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 531/1077] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:51:59 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/53925cdf5a744200910943966d84ed40/roles/92e957cc2db94efb80b06e2b8e77ec0e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:00.055942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2552f-680f-4b5c-8eef-886c4e5e35a5 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.056363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2552f-680f-4b5c-8eef-886c4e5e35a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.056502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2552f-680f-4b5c-8eef-886c4e5e35a5 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.057875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 547/1078] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:00.063037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.063467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.063629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.081197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:00.082402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:00.137423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.149265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 532/1079] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:00.172284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2552f-680f-4b5c-8eef-886c4e5e35a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:00.274939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2552f-680f-4b5c-8eef-886c4e5e35a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:00.308562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:00.309279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.309567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.309842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.319886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:00.327436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:00.328535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:00.329397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 548/1080] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:00.335275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:00.431239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b2334-c6a1-4097-abcd-77c2f124a59d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:00.465084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:00.465753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.466038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.466315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.467058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:00.467365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:00.468768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:00.477285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 533/1081] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:00.482979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:00.514982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.584111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c807e5-c4fb-4f7f-8ef9-b7d0e7adb43b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:00.616428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:00.617294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.617578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.617857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] PATH_INFO: `/v3/users/61e2afccbddd4b17aaba26f25826a9b1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.619028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] RBAC: Authorizing `identity:get_user(user_id=61e2afccbddd4b17aaba26f25826a9b1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:00.620481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:00.622105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 549/1082] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:00 2022] GET /identity/v3/users/61e2afccbddd4b17aaba26f25826a9b1 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:00.628913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:00.718996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.764913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6d863a-6560-4eae-8eb3-cfe2a82bfad8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:00.798128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:00.799492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.799806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.800086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.801276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:00.802709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b402595-3975-4059-b5ea-2255bfcae390 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:00.804460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 534/1083] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:00 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:00.810342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:00.908633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:00.911660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caaf1f-f3a3-4d58-b99d-7279d5e6e6b4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:00.946230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:00.947145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:00.947432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:00.947877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3/users/61e2afccbddd4b17aaba26f25826a9b1/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:00.949849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] RBAC: Authorizing `identity:create_grant(project_id=7c73a3f2413b42289097ca70689339b3, user_id=61e2afccbddd4b17aaba26f25826a9b1, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:00.951273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44afd3f8-0822-4b48-86d9-3cd158cc1590 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:01.021276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 550/1084] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:52:00 2022] PUT /identity/v3/projects/7c73a3f2413b42289097ca70689339b3/users/61e2afccbddd4b17aaba26f25826a9b1/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:01.828784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4bef-50b0-4b66-a4f8-011f89832a99 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:01.829316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4bef-50b0-4b66-a4f8-011f89832a99 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:01.829316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13d4bef-50b0-4b66-a4f8-011f89832a99 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:01.831230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 535/1085] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:01.836746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:01.837132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:01.837313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:01.854350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:01.855527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:01.920274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 551/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:01.944335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4bef-50b0-4b66-a4f8-011f89832a99 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.045250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13d4bef-50b0-4b66-a4f8-011f89832a99 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.066703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:02.084673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.084673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.084673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.084673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.092391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:02.101604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:02.102631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:02.103463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 536/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jul 25 05:52:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:02.109386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.198515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:02.207754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf90701-ec9b-4158-b360-d59e49d86e36 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.241751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.242476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.242762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.243065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.243830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:02.244140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:02.245492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:02.253410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 552/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:02.259498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.356480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f61b6-4d38-4b4e-a77f-33af26b4188b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.387930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.388705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.388987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.389260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.399885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:02.401408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:52:02.418525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:02.419548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:02.420477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:52:02.420477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:52:02.420477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:52:02.420477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:02.420477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 537/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:52:02.425745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.523384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b6285-ee7c-466f-a672-efc3bf2ca260 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.556928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.557589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.557878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.558160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.558875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:02.559184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:02.560587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:02.572299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 553/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:02.577874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.610750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:02.684821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f0dee-d4d2-4d76-aeb6-a9dd5815bc1f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.718401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.719190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.719474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.719772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.727862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:02.729280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:52:02.744415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:02.745551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:02.746536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 538/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:02.751269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:02.766710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:02.852565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0329dcd7-37cc-4246-bf8e-57c1b2f27a62 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:02.886249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:02.886842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:02.887123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:02.887395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:02.888259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:02.888566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:02.889972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53bdf0-1b63-4c24-ae70-88f88fe5e912 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:02.907095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 554/1092] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:02.913325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.003248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.011906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b177d8c-caca-4933-9e28-aaf735188614 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.031017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1aad3-e382-4c3e-bf30-a72fc6414ca8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.031570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1aad3-e382-4c3e-bf30-a72fc6414ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.032084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1aad3-e382-4c3e-bf30-a72fc6414ca8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.033946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 555/1093] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 05:52:03.039637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.040163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.040651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.047657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.048333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.048655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.049115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.057583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:03.058760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:03.116275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.117943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.122767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.127462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 556/1094] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:52:03.151344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.209844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.219574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 539/1095] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:03.225864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.250821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15231a0b-8783-44e0-8c85-889a71ebee37 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.285151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.285940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.286225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.286503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.296705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:03.304337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:03.305291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:03.306279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 557/1096] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:52:03.311454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.324316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449044c-ba89-4a15-b235-ba4ebded94be None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.358480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.359274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.359580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.359856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.369721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.371081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.371201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:52:03.388686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:03.389600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:03.390593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:52:03.390593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:52:03.390593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:52:03.390593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:03.390593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 540/1097] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:52:03.396428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.412872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf2c44-7039-4104-b60a-0e864e7475b4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.441395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.446887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.447548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.447857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.448137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.448897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:03.449259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.450596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.459773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 558/1098] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:03.465428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.494940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77f4ac-aa57-4d16-b399-faf6bfcdaea6 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.529977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.530637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.530926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.531204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.532019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:03.532328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.533810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.544881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 541/1099] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:03.551337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.564727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f346d56-62d9-4af0-b574-4034aa8d1e6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.587415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.597871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.598740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.599023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.599300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] PATH_INFO: `/v3/users/61e2afccbddd4b17aaba26f25826a9b1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.600543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] RBAC: Authorizing `identity:get_user(user_id=61e2afccbddd4b17aaba26f25826a9b1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.602010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.603678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 559/1100] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/users/61e2afccbddd4b17aaba26f25826a9b1 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:03.609418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.655956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7ed00-b30c-4cd0-8cb9-91c63bbaaa5b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.658428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.723868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.724593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.724932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.725214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.732064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.733494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:52:03.747961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:03.748886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:03.749792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 542/1101] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:52:03.755610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.757973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f0408-1352-4325-8825-dcfc5f65bb6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.790930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.791601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.791893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.792172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.849364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.852527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f242b-cc21-4fcb-9f1e-efb91183dbe1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:03.859268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.860734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.887999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:03.888740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:03.889110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:03.889390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:03.890208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:03.890520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:03.891966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:03.903482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 543/1102] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:03.909464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:03.934403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:03.964148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 560/1103] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:52:03.969883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:04.010005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0705c1-cae7-4fc1-b957-1948d16a12e5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:04.045844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:04.046766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:04.047051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:04.047325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:04.048172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] RBAC: Adding query filter params (role.id=92e957cc2db94efb80b06e2b8e77ec0e, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=53925cdf5a744200910943966d84ed40) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:04.048505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:04.051087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:04.056614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 544/1104] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/role_assignments?user.id=53925cdf5a744200910943966d84ed40&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=92e957cc2db94efb80b06e2b8e77ec0e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:04.066374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:04.076415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93252f7-9d82-49bd-89ab-c0716cc7f81d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:04.115381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:04.116298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:04.116582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:04.116858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:04.118074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:04.119520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40f9aa-c86d-42f4-ab6a-87b643138895 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:04.121308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 561/1105] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:03 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:04.128552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:04.222224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:04.234225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddfc0-eb51-4573-b849-5040b43668f0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:04.268829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:04.269408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:04.269692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:04.269967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:04.270781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=7c73a3f2413b42289097ca70689339b3, user.id=61e2afccbddd4b17aaba26f25826a9b1) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:04.271091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:04.272540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6a2f2-d56c-4f90-85d8-f10e908f0d5d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:04.278571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 545/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:04 2022] GET /identity/v3/role_assignments?user.id=61e2afccbddd4b17aaba26f25826a9b1&scope.project.id=7c73a3f2413b42289097ca70689339b3&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:06.325154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53cc0-be79-43bc-9466-8c57711f2466 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:06.325657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53cc0-be79-43bc-9466-8c57711f2466 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:06.325657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53cc0-be79-43bc-9466-8c57711f2466 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:06.327005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 562/1107] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:06.332220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:06.332604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:06.332776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:06.349443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:06.350623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:06.416292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 546/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:06.441350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53cc0-be79-43bc-9466-8c57711f2466 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:06.540529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e53cc0-be79-43bc-9466-8c57711f2466 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:06.574341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:06.575122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:06.575454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:06.575720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:06.576879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:06.578290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a771621-6ca7-46cc-b7d4-662111db513e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:06.580175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 563/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:52:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:06.585818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:06.665048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:06.683215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443a96a-650e-45cc-b9ae-079bb6069b20 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:06.716321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:06.716981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:06.717331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:06.717619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:06.718335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:06.719777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c365a-5e26-4914-861f-2bf5252b6275 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:06.825399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 547/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:52:06 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:08.904835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b89e6-df90-491c-a154-51d062d06fad None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:08.905420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b89e6-df90-491c-a154-51d062d06fad None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:08.905420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b89e6-df90-491c-a154-51d062d06fad None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:08.906785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 564/1111] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:08.912548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:08.912979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:08.913126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:08.930352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:08.931543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:08.996389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 548/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:09.020341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b89e6-df90-491c-a154-51d062d06fad None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:09.047750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:09.120605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b89e6-df90-491c-a154-51d062d06fad None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:09.153405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:09.154278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:09.154562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:09.154885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] PATH_INFO: `/v3/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:09.156346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] RBAC: Authorizing `identity:get_role(role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:09.158260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:09.159647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 565/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:09 2022] GET /identity/v3/roles/806a50b089f44cb48562ccf8ff703763 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:09.165439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:09.229763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:09.261286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd498-dab0-45a6-acb1-3910839cdec0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:09.295497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:09.296633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:09.296915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:09.297189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] PATH_INFO: `/v3/users/46b9977c81654bd6998cd5051ed71d6a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:09.310330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] RBAC: Authorizing `identity:get_user(user_id=46b9977c81654bd6998cd5051ed71d6a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:09.311775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:09.313390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 549/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:09 2022] GET /identity/v3/users/46b9977c81654bd6998cd5051ed71d6a => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:09.319128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:09.409629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:09.416045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f201224-fd10-4358-9cbe-a79044bfc8bb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:09.449694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:09.450336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:09.450622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:09.450902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:09.515742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:09.517773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:09.605147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:09.612501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 566/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:09.618456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:09.716695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa9258-108d-4c1b-9ab3-3127ae95118a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:09.741937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:09.750272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:09.751122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:09.751434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:09.752292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:09.753467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:09.754893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce421cbe-3ae7-4ec1-b593-d75a0314d701 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:09.756617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 550/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:09 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:09.762633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:09.858044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53341b5-c63e-4d01-a433-7e43c9ebbf89 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:09.891595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:09.892442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:09.892739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:09.893018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:09.893846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=7c73a3f2413b42289097ca70689339b3, user.id=46b9977c81654bd6998cd5051ed71d6a) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:09.894193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:09.895635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f133c6-e913-4bec-8e99-08c51b3ce08e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:09.900903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 567/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:09 2022] GET /identity/v3/role_assignments?user.id=46b9977c81654bd6998cd5051ed71d6a&scope.project.id=7c73a3f2413b42289097ca70689339b3&role.id=806a50b089f44cb48562ccf8ff703763 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:11.895894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a8e1-53f6-4eba-9c90-0395c5582f61 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:11.896472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a8e1-53f6-4eba-9c90-0395c5582f61 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:11.896472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61a8e1-53f6-4eba-9c90-0395c5582f61 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:11.897824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 551/1118] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:11.902956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:11.903389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:11.903519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:11.920429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:11.921880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:11.973814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:11.987688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 568/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:12.010295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a8e1-53f6-4eba-9c90-0395c5582f61 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:12.109191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c61a8e1-53f6-4eba-9c90-0395c5582f61 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:12.141134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:12.142583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:12.142899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:12.143288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] PATH_INFO: `/v3/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:12.144787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] RBAC: Authorizing `identity:get_role(role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:12.146199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:12.147500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 552/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:12 2022] GET /identity/v3/roles/806a50b089f44cb48562ccf8ff703763 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:12.153317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:12.250127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42da6b7-644c-4eae-9dac-2c147e3b7f35 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:12.283639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:12.284496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:12.284780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:12.285057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] PATH_INFO: `/v3/users/46b9977c81654bd6998cd5051ed71d6a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:12.286233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] RBAC: Authorizing `identity:get_user(user_id=46b9977c81654bd6998cd5051ed71d6a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:12.287691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:12.289308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 569/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:12 2022] GET /identity/v3/users/46b9977c81654bd6998cd5051ed71d6a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:12.294962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:12.354785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:12.393184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d5311-3541-4b75-8309-8d19bf760cd1 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:12.425243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:12.426026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:12.426307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:12.426577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:12.427762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:12.429175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb74853-b14f-49f9-86bd-125fa5709454 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:12.430836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 553/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:12 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:12.436937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:12.492196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:12.534339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226660f-6b2c-4abd-bd95-b9e9f705fd30 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:12.567383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:12.568288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:12.568571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:12.568851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3/users/46b9977c81654bd6998cd5051ed71d6a/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:12.571053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] RBAC: Authorizing `identity:create_grant(project_id=7c73a3f2413b42289097ca70689339b3, user_id=46b9977c81654bd6998cd5051ed71d6a, role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:12.572504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b7b4f-4b13-47ad-81e3-fc811bd3c6fd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:12.638033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 570/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:52:12 2022] PUT /identity/v3/projects/7c73a3f2413b42289097ca70689339b3/users/46b9977c81654bd6998cd5051ed71d6a/roles/806a50b089f44cb48562ccf8ff703763 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:14.645138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d92d-bead-464c-a97a-4ff89cfcead6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:14.645687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d92d-bead-464c-a97a-4ff89cfcead6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:14.645687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165d92d-bead-464c-a97a-4ff89cfcead6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:14.647061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 554/1124] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:14.652166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:14.652593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:14.652760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:14.669684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:14.671142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:14.736283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 571/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:14.759338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165d92d-bead-464c-a97a-4ff89cfcead6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:14.858296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165d92d-bead-464c-a97a-4ff89cfcead6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:14.894725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:14.900389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:14.901195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:14.901483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:14.901765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] PATH_INFO: `/v3/roles/806a50b089f44cb48562ccf8ff703763` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:14.903277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] RBAC: Authorizing `identity:get_role(role_id=806a50b089f44cb48562ccf8ff703763)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:14.904679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:14.906047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 555/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:14 2022] GET /identity/v3/roles/806a50b089f44cb48562ccf8ff703763 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:14.915721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:14.957977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:15.010173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430d16a-b91d-4d6a-a551-3d2d937e3bad None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:15.044298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:15.045098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:15.045380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:15.045655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] PATH_INFO: `/v3/users/46b9977c81654bd6998cd5051ed71d6a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:15.047093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=46b9977c81654bd6998cd5051ed71d6a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:15.049087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:15.050716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 572/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:14 2022] GET /identity/v3/users/46b9977c81654bd6998cd5051ed71d6a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:15.056384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:15.154130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c2b4b-37b8-47ea-8e3e-292edf48b99c None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:15.188118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:15.188885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:15.189171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:15.189452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:15.251032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:15.254437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:15.255891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:15.351048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 556/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:52:15.356948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:15.453738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06146b41-77d4-4cf4-ad48-48e50efa7ef9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:15.467191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:15.487838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:15.488694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:15.488987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:15.489269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] PATH_INFO: `/v3/projects/7c73a3f2413b42289097ca70689339b3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:15.490441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] RBAC: Authorizing `identity:get_project(project_id=7c73a3f2413b42289097ca70689339b3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:15.491898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836243-b298-46bf-8a81-5719128ca34a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:15.493590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 573/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:15 2022] GET /identity/v3/projects/7c73a3f2413b42289097ca70689339b3 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:15.499672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:15.591365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:15.595645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b94d4-51b7-4cdb-9fea-8899ee8be1cb None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:15.628720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:15.629367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:15.629657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:15.629939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:15.630763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] RBAC: Adding query filter params (role.id=806a50b089f44cb48562ccf8ff703763, scope.project.id=7c73a3f2413b42289097ca70689339b3, user.id=46b9977c81654bd6998cd5051ed71d6a) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:15.631078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:15.632514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523006a-7b71-4f46-98c1-506dad680921 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:15.638190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 557/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:15 2022] GET /identity/v3/role_assignments?user.id=46b9977c81654bd6998cd5051ed71d6a&scope.project.id=7c73a3f2413b42289097ca70689339b3&role.id=806a50b089f44cb48562ccf8ff703763 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:17.677071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3118d0-2899-4744-92d1-d1760fdbb254 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:17.677602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3118d0-2899-4744-92d1-d1760fdbb254 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:17.677602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3118d0-2899-4744-92d1-d1760fdbb254 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:17.678988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 574/1131] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:17.684113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:17.684521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:17.684677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:17.701665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:17.702844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:17.767439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 558/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:17.790313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3118d0-2899-4744-92d1-d1760fdbb254 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:17.887850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3118d0-2899-4744-92d1-d1760fdbb254 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:17.920185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:17.921213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:17.921493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:17.921768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:17.922916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:17.924387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656f79d-f022-462b-819d-407a4d47e725 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:17.925972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 575/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:52:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:17.931730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:18.019180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:18.027337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785345e-31f0-4f2e-afe9-168d59363883 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:18.060515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:18.061173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:18.061461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:18.061739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:18.062438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:18.064428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310aba87-8641-4cf6-8542-f0df80fcb018 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:18.148097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 559/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:52:17 2022] POST /identity/v3/projects => generated 311 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:20.184862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d20-e249-427e-92ad-e016e4141cf7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:20.185407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d20-e249-427e-92ad-e016e4141cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:20.185407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2d20-e249-427e-92ad-e016e4141cf7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:20.186814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 576/1135] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:20.192620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:20.193026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:20.193193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:20.210266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:20.211464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:20.276579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 560/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:20.302772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2d20-e249-427e-92ad-e016e4141cf7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:20.354106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:20.404125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2d20-e249-427e-92ad-e016e4141cf7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:20.437270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:20.438048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:20.438334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:20.439220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:20.440402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:20.441819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254d73f-c34e-43a6-8e29-866d19edcbf7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:20.443418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 577/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:52:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:20.449171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:20.522382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:20.546646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fcc01-b07e-4364-b4ae-adfdf768448b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:20.581963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:20.582569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:20.582859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:20.583141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:20.583891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:20.585329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448a86-af5a-47b2-a093-109698e20daf None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:20.689231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 561/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:52:20 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:52:22.743882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960941f-f145-418f-bb0e-cd6e847f55c7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.744412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960941f-f145-418f-bb0e-cd6e847f55c7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.744505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960941f-f145-418f-bb0e-cd6e847f55c7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:22.745826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 578/1139] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:22.751842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.752238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.752408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:22.768767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:22.769955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:22.834475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 562/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:22.858013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960941f-f145-418f-bb0e-cd6e847f55c7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:22.958287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960941f-f145-418f-bb0e-cd6e847f55c7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:22.975274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:22.991825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:22.992608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:22.992893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:22.993170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.003165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:23.010898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:23.012117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:23.013491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 579/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:23.018207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.075743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:23.116041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7ce25-1474-4828-9de9-96b46122c3b8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.148711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.149371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.149657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.149937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.150680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:23.150989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.152378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.161167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 563/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:23.166926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.265410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab5ac2-afeb-45b4-bff9-71c8987da4e9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.299568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.300420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.300703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.300979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] PATH_INFO: `/v3/users/aef3f51529f64583905767b1d394ad51` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.313687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] RBAC: Authorizing `identity:get_user(user_id=aef3f51529f64583905767b1d394ad51)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.315102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.316761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 580/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/users/aef3f51529f64583905767b1d394ad51 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:23.322416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.420047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b0ac0-a08b-49a5-8de6-28a6d478d8ac None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.441665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:23.452981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.453617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.453903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.454834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.520314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.521698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.617271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 564/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:23.623257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.658017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:23.720609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1eebd-4461-4692-9ecf-c6eb0f1466b2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.753337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.754181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.754466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.754741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] PATH_INFO: `/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.755920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] RBAC: Authorizing `identity:get_project(project_id=8fd91dbaaf0c4a1084830059b6cd6050)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.757334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b4256-d49f-43d4-80c3-b9f5b7d64d4d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.759003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 581/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:23.765008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:23.788575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:23.862765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b60b3-b333-4e79-b0c2-bd82b6c41cf0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:23.896289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:23.896931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:23.897219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:23.897497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:23.898316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=8fd91dbaaf0c4a1084830059b6cd6050, user.id=aef3f51529f64583905767b1d394ad51) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:23.898630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:23.900099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5471a9a-662e-4a21-8746-303703d44409 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:23.905402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 565/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:23 2022] GET /identity/v3/role_assignments?user.id=aef3f51529f64583905767b1d394ad51&scope.project.id=8fd91dbaaf0c4a1084830059b6cd6050&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:25.892217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce82ac-2276-4e70-b0fd-e851482cd392 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:25.892837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce82ac-2276-4e70-b0fd-e851482cd392 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:25.892837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce82ac-2276-4e70-b0fd-e851482cd392 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:25.894144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 582/1147] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:25.899273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:25.899719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:25.899867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:25.916908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:25.918090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:25.982600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 566/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:26.005192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce82ac-2276-4e70-b0fd-e851482cd392 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:26.106225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce82ac-2276-4e70-b0fd-e851482cd392 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:26.108502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:26.139146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:26.139959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:26.140247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:26.140523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:26.150942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:26.159128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:26.160272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:26.161306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 583/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:26.166408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:26.184338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:26.269449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69556430-e046-49ef-bdb3-bb64da177150 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:26.302874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:26.303529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:26.303843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:26.304119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:26.304850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:26.305153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:26.306498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:26.315111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 567/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:26.321132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:26.416922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33359-3313-487b-b83c-089ce565c4a0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:26.449464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:26.450312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:26.450596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:26.450872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] PATH_INFO: `/v3/users/aef3f51529f64583905767b1d394ad51` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:26.452063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] RBAC: Authorizing `identity:get_user(user_id=aef3f51529f64583905767b1d394ad51)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:26.453481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:26.455735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 584/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:26 2022] GET /identity/v3/users/aef3f51529f64583905767b1d394ad51 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:26.461493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:26.537471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:26.558723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5777da20-75f4-445d-bb2d-aab3595b5f7a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:26.591362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:26.592241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:26.592527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:26.592806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] PATH_INFO: `/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:26.593968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] RBAC: Authorizing `identity:get_project(project_id=8fd91dbaaf0c4a1084830059b6cd6050)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:26.596027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4579763-4195-4d9b-9b6f-d414b9181f05 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:26.597701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 568/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:26 2022] GET /identity/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:26.603581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:26.634197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:26.700584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8790-4945-474d-909c-0828ac427790 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:26.733286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:26.734148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:26.734430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:26.734708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] PATH_INFO: `/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050/users/aef3f51529f64583905767b1d394ad51/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:26.736815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=8fd91dbaaf0c4a1084830059b6cd6050, user_id=aef3f51529f64583905767b1d394ad51, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:26.738215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215e1fc-49f5-44cc-a7cb-a4d6109aa0a5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:26.819213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 585/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:52:26 2022] PUT /identity/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050/users/aef3f51529f64583905767b1d394ad51/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 05:52:28.818844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e70b3-bbc2-45da-8691-47e9846d536d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:28.819410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e70b3-bbc2-45da-8691-47e9846d536d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:28.819410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e70b3-bbc2-45da-8691-47e9846d536d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:28.820791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 569/1154] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:28.825939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:28.826365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:28.826494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:28.842816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:28.844021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:28.909010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 586/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:28.932891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e70b3-bbc2-45da-8691-47e9846d536d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.030258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e70b3-bbc2-45da-8691-47e9846d536d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.064695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.065485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.065767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.066039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.075946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:29.083674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:29.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:29.085456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 570/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:29.090828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.115698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:29.188596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0276381-644d-44ce-a3da-63fc981be91e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.221229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.221880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.222165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.222442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.223181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:29.223487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:29.224869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:29.232684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 587/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:29.239341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.248592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:29.338793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce803c-99ca-44d0-84b4-91ccbb141d78 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.371369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.372256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.372541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.372817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] PATH_INFO: `/v3/users/aef3f51529f64583905767b1d394ad51` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.373986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] RBAC: Authorizing `identity:get_user(user_id=aef3f51529f64583905767b1d394ad51)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:29.375417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:29.377154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 571/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:29 2022] GET /identity/v3/users/aef3f51529f64583905767b1d394ad51 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:29.382824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.465754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:29.481565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8570-3d5f-43ae-944a-ae9acff6cb7f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.514196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.514835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.515119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.515397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.581170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:29.582647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:29.663593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:29.680114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 588/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:29.686222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.760645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:29.784709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93946cce-ffc2-497c-aecc-13736dc26eff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.817657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.818502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.818787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.819067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] PATH_INFO: `/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.820292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] RBAC: Authorizing `identity:get_project(project_id=8fd91dbaaf0c4a1084830059b6cd6050)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:29.821715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef95fd7-f2ab-4b96-8cba-dfb5e3e573bb None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:29.823401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 572/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:29 2022] GET /identity/v3/projects/8fd91dbaaf0c4a1084830059b6cd6050 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:29.829465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:29.925916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c3a22-ba37-4471-bd76-b0083fb36ed9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:29.958108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:29.958748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:29.959035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:29.959312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:29.960159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=8fd91dbaaf0c4a1084830059b6cd6050, user.id=aef3f51529f64583905767b1d394ad51) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:29.960466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:29.961868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c44c81-a8fe-4434-98da-01f559e11dc8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:29.967492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 589/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:29 2022] GET /identity/v3/role_assignments?user.id=aef3f51529f64583905767b1d394ad51&scope.project.id=8fd91dbaaf0c4a1084830059b6cd6050&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:32.031416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641eb1-4891-42e8-8a0a-7c134ccbec24 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:32.032079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641eb1-4891-42e8-8a0a-7c134ccbec24 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:32.032079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641eb1-4891-42e8-8a0a-7c134ccbec24 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:32.033432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 573/1162] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:32.038759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:32.039143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:32.039313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:32.056047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:32.057217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:32.099434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:32.121732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 590/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:32.144847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641eb1-4891-42e8-8a0a-7c134ccbec24 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:32.244809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641eb1-4891-42e8-8a0a-7c134ccbec24 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:32.277501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:32.278135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:32.278425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:32.278704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:32.290230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:32.344540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:32.346001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:32.441053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 574/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:32.446963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:32.544178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e6d29-f080-4477-b785-09e77fd4e58d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:32.577047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:32.577845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:32.578130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:32.578407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:32.585479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:32.586902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0b3f708d-4bf2-4a66-ab28-095b022134d1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:32.601289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:32.602496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:32.603358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 591/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:52:32 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:32.608423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:32.650751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:32.705283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d06c54-5195-487f-b9be-8dfe43718886 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:32.737366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:32.738018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:32.738304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:32.738582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:32.739327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:32.739661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:32.741016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d5991-c056-46f4-a859-324b22e908d0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:32.747970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 575/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jul 25 05:52:32 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:34.744762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fde9-401f-4bb8-ae2b-bfcb0846741e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:34.745318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fde9-401f-4bb8-ae2b-bfcb0846741e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:34.745318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b29fde9-401f-4bb8-ae2b-bfcb0846741e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:34.746716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 592/1167] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:34.752530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a90e-bfab-42a4-bac7-16807e6f7414 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:34.752941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a90e-bfab-42a4-bac7-16807e6f7414 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:34.753104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030a90e-bfab-42a4-bac7-16807e6f7414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:34.769454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e030a90e-bfab-42a4-bac7-16807e6f7414 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:34.770653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e030a90e-bfab-42a4-bac7-16807e6f7414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:34.836036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 576/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:34.859109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29fde9-401f-4bb8-ae2b-bfcb0846741e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:34.899776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:34.959288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b29fde9-401f-4bb8-ae2b-bfcb0846741e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:34.992936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:34.993584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:34.993866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:34.994142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:34.994919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:34.996236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9783d-fe40-4726-b077-5eafa51a688f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:35.065711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 593/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Mon Jul 25 05:52:34 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:37.197142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08085-62f7-4922-bf44-2a96d7d87ea9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.197666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08085-62f7-4922-bf44-2a96d7d87ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.197754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08085-62f7-4922-bf44-2a96d7d87ea9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.199062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 577/1170] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:37.204604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.205058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.205202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.222181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:37.223370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:37.289009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 594/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:37.313521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c08085-62f7-4922-bf44-2a96d7d87ea9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.348683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:37.413157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c08085-62f7-4922-bf44-2a96d7d87ea9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.447064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.447950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.448239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.448519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] PATH_INFO: `/v3/domains/fd92dab6ef184434bd798027b39991c3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.458813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd92dab6ef184434bd798027b39991c3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.460429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fe7d4-433e-4282-8c99-6438ae001107 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.462080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 578/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Jul 25 05:52:37 2022] GET /identity/v3/domains/fd92dab6ef184434bd798027b39991c3 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:37.467990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:37.495956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:37.567288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33caf2-db79-4ff3-a4b1-b7bd1ed15b2b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:37.601468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ce516-28e0-4564-8986-ada03991658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:37.602123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce516-28e0-4564-8986-ada03991658d None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:37.602412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce516-28e0-4564-8986-ada03991658d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:37.602690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ce516-28e0-4564-8986-ada03991658d None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:37.603400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce516-28e0-4564-8986-ada03991658d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:37.604848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ce516-28e0-4564-8986-ada03991658d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:37.684315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 595/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:52:37 2022] POST /identity/v3/projects => generated 361 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:52:39.724140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4407-9633-46d9-850c-60f16cf41f11 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:39.724714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4407-9633-46d9-850c-60f16cf41f11 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:39.724714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c4407-9633-46d9-850c-60f16cf41f11 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:39.726079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 579/1174] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:39.731445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:39.731878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:39.732039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:39.748369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:39.749556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:39.815159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 596/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:39.839507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4407-9633-46d9-850c-60f16cf41f11 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:39.932227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:39.938530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c4407-9633-46d9-850c-60f16cf41f11 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:39.972007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:39.972858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:39.973145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:39.973426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] PATH_INFO: `/v3/domains/fd92dab6ef184434bd798027b39991c3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:39.974642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=fd92dab6ef184434bd798027b39991c3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:39.976053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b938944-a0c6-4a13-b2e0-f99f61a485ae None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:39.977648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 580/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Jul 25 05:52:39 2022] GET /identity/v3/domains/fd92dab6ef184434bd798027b39991c3 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:39.983321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:39.994717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:40.080650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36de935-a813-4b8d-9e14-cc6ddff31417 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:40.112872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:40.113531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:40.113812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:40.114087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:40.114788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:40.116239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba60ad-ab73-4c9d-9307-d6848f963eed None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:40.214387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 597/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:52:39 2022] POST /identity/v3/users => generated 311 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:52:42.303944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5648-0508-4701-9dd3-bd2955be5538 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.304454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5648-0508-4701-9dd3-bd2955be5538 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.304454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd5648-0508-4701-9dd3-bd2955be5538 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.305775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 581/1178] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:42.310979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.311371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.311537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.328322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:42.330041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:42.387617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:42.395368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 598/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:42.418531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd5648-0508-4701-9dd3-bd2955be5538 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.519265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd5648-0508-4701-9dd3-bd2955be5538 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:42.552998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:42.553773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.554105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.554332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.564236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:42.571778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:42.572952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:42.574034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 582/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:42.578904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.677046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80284bdd-0f12-4ea7-b26c-c41190c30713 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:42.709997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:42.710657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.710946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.711229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.712004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:42.712315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:42.713676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:42.722215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 599/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:42.727908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.752388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:42.822996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4b442-6c6f-4404-988f-80eed762d907 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:42.855731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:42.856584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:42.856866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:42.857139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] PATH_INFO: `/v3/users/a9871836876248a69c476bb4f44882be` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:42.869991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] RBAC: Authorizing `identity:get_user(user_id=a9871836876248a69c476bb4f44882be)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:42.871449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:42.873149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 583/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/users/a9871836876248a69c476bb4f44882be => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:52:42.878851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:42.935993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:42.978131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb213d5-9d8c-415e-b982-36b5085a8323 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:43.015137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:43.015807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.016095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.016372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.087902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:43.089280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:43.145283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:43.185404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 600/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:43.191938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:43.271753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:43.289027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d4def-f071-4010-b81b-b4052b57ace0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:43.322089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:43.322940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.323224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.323510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] PATH_INFO: `/v3/projects/11f555cd1a9b4ad4973182143f019f5a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.324704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] RBAC: Authorizing `identity:get_project(project_id=11f555cd1a9b4ad4973182143f019f5a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:43.326116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4468e0-6f28-4c4a-9751-2de93eb712df None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:43.327817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 584/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:43 2022] GET /identity/v3/projects/11f555cd1a9b4ad4973182143f019f5a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:43.334573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:43.430823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69455b-348e-4d17-afeb-f98dc1dec097 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:43.464903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:43.465543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:43.465824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:43.466096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:43.466916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=11f555cd1a9b4ad4973182143f019f5a, user.id=a9871836876248a69c476bb4f44882be) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:43.467222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:43.468682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9793e055-5a55-4a4b-84ec-57e4b6de4e19 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:43.474249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 601/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:43 2022] GET /identity/v3/role_assignments?user.id=a9871836876248a69c476bb4f44882be&scope.project.id=11f555cd1a9b4ad4973182143f019f5a&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:45.466478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7738c22-1ca4-4984-a033-33d9289efae2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:45.466980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7738c22-1ca4-4984-a033-33d9289efae2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:45.466980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7738c22-1ca4-4984-a033-33d9289efae2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:45.468346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 585/1186] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:45.473998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:45.474432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:45.474546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:45.491416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:45.492622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:45.508606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:45.557921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 602/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:45.580210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7738c22-1ca4-4984-a033-33d9289efae2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:45.679623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7738c22-1ca4-4984-a033-33d9289efae2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:45.712577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:45.713356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:45.713645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:45.713924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:45.724518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:45.732131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:45.733220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:52:45.734124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 586/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:45.739304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:45.836506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ffd3a-4a86-4909-9930-361588ebd482 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:45.869675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:45.870332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:45.870619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:45.870898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:45.871667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:45.871976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:45.873329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:45.881222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 603/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:45.886920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:45.899940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:45.985347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f119d-8c4e-4a11-bec2-769c9922acbd None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:46.018151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:46.019010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:46.019352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:46.019670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] PATH_INFO: `/v3/users/a9871836876248a69c476bb4f44882be` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:46.020840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] RBAC: Authorizing `identity:get_user(user_id=a9871836876248a69c476bb4f44882be)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:46.022261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:46.023896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 587/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:45 2022] GET /identity/v3/users/a9871836876248a69c476bb4f44882be => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:46.029646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:46.046764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:46.128220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a37387-2b0a-4c81-a6f4-93abf9fea225 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:46.161368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:46.162239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:46.162523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:46.162801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] PATH_INFO: `/v3/projects/11f555cd1a9b4ad4973182143f019f5a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:46.163993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] RBAC: Authorizing `identity:get_project(project_id=11f555cd1a9b4ad4973182143f019f5a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:46.165400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb83eb-dfb4-44e9-a095-d9cfcdfd504d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:46.167078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 604/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:46 2022] GET /identity/v3/projects/11f555cd1a9b4ad4973182143f019f5a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:46.173463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:46.250012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:46.270937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b4f48-f2dd-466d-9d94-b98ebd2fd438 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:46.304440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:46.305321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:46.305607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:46.305892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] PATH_INFO: `/v3/projects/11f555cd1a9b4ad4973182143f019f5a/users/a9871836876248a69c476bb4f44882be/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:46.307863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] RBAC: Authorizing `identity:create_grant(project_id=11f555cd1a9b4ad4973182143f019f5a, user_id=a9871836876248a69c476bb4f44882be, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:46.309280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00447e-133e-44e6-acd1-2ee3a57d800c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:46.372180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 588/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:52:46 2022] PUT /identity/v3/projects/11f555cd1a9b4ad4973182143f019f5a/users/a9871836876248a69c476bb4f44882be/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:52:48.381273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9882a6-bde4-4f9e-9857-6b95b58ed6b5 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:48.381787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9882a6-bde4-4f9e-9857-6b95b58ed6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:48.381787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9882a6-bde4-4f9e-9857-6b95b58ed6b5 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:48.383098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 605/1193] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:52:48.388335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:48.388760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:48.388901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:48.405922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:52:48.407130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:52:48.471799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 589/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:52:48.494884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9882a6-bde4-4f9e-9857-6b95b58ed6b5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:48.575736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:48.594464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9882a6-bde4-4f9e-9857-6b95b58ed6b5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:48.628003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:48.628777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:48.629059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:48.629333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:48.639239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:52:48.647400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:52:48.648518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:52:48.649740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 606/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:52:48.654676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:48.719279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:48.752311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d852a6-d5b8-4af2-af7c-15e1c8ea9523 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:48.785766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:48.786419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:48.786705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:48.786981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:48.787748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:48.788056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:48.789416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:48.797522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 590/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:48.803725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:48.900269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950eeada-b7c8-4190-b016-de06c8f2dcf1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:48.932704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:48.933554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:48.933838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:48.934113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] PATH_INFO: `/v3/users/a9871836876248a69c476bb4f44882be` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:48.935286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] RBAC: Authorizing `identity:get_user(user_id=a9871836876248a69c476bb4f44882be)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:48.936740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:48.938373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 607/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jul 25 05:52:48 2022] GET /identity/v3/users/a9871836876248a69c476bb4f44882be => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:48.944577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:49.041071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1cbf5-b687-46d9-b89f-bb4ed73f7450 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:49.070567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:49.076256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:49.083742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:49.083742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:49.083742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:49.144445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:49.145921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:49.241785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 591/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:52:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:52:49.247699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:49.260192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:49.345198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a351ba9-b903-4106-9c57-136c1e8f00e3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:49.377790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:49.378628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:49.378906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:49.379179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] PATH_INFO: `/v3/projects/11f555cd1a9b4ad4973182143f019f5a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:49.380347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] RBAC: Authorizing `identity:get_project(project_id=11f555cd1a9b4ad4973182143f019f5a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:49.381756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acdd97-7239-47d0-b758-7625acd9543f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:49.383453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 608/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jul 25 05:52:49 2022] GET /identity/v3/projects/11f555cd1a9b4ad4973182143f019f5a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:49.389469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:52:49.418174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:49.485411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f19c8-4225-440a-bb96-f78a96309827 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:52:49.517752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:52:49.518328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:52:49.518611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:52:49.518884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:52:49.519722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=11f555cd1a9b4ad4973182143f019f5a, user.id=a9871836876248a69c476bb4f44882be) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:52:49.520031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:52:49.521425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7634f5a-8c1e-4144-9bd8-6ea2a98c04f9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:52:49.527028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 592/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:52:49 2022] GET /identity/v3/role_assignments?user.id=a9871836876248a69c476bb4f44882be&scope.project.id=11f555cd1a9b4ad4973182143f019f5a&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:52:59.373719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=61 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:52:59.524459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=53 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:01.970150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e248b-aef4-4711-87ae-b7897fd54bc7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:01.970746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e248b-aef4-4711-87ae-b7897fd54bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:01.970746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e248b-aef4-4711-87ae-b7897fd54bc7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:01.972099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 609/1201] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:01.978157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:01.987633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:01.987633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:01.995895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:01.997067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:02.063664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 593/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:02.089048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e248b-aef4-4711-87ae-b7897fd54bc7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:02.192015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e248b-aef4-4711-87ae-b7897fd54bc7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:02.224889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:02.225609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:02.225894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:02.226169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:02.236167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:02.237613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:02.255301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:02.256622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:02.257628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:02.257628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:02.257628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:02.257628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:02.257628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 610/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:02.262493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:02.359130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483304fa-91f6-4765-8e98-22d91bca424f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:02.387769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:02.393476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:02.394993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:02.394993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:02.394993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:02.395386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:02.395751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:02.397233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9f83c-668b-48b2-a03a-02ec7b17776c None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:02.408110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 594/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:02.415042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:02.468460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:02.513538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed8c1b-d9dd-4890-b940-3e1af52dcff9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:02.547487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:02.548172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:02.548453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:02.548726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:02.549437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:02.550954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81066a12-f3ee-4d7c-ab64-8aa78fecc8e6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:02.643963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 611/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jul 25 05:54:02 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 05:54:04.707693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171d22-8954-4cab-a52b-73e5610c1393 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:04.708792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171d22-8954-4cab-a52b-73e5610c1393 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:04.708792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85171d22-8954-4cab-a52b-73e5610c1393 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:04.710121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 595/1206] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:04.715510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:04.715945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:04.716098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:04.733442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:04.734640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:04.800127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 612/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:04.823384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85171d22-8954-4cab-a52b-73e5610c1393 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:04.923544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85171d22-8954-4cab-a52b-73e5610c1393 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:04.959294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:04.960043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:04.960322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:04.960593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:04.970848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:04.979512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:04.984453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:04.985476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 596/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:54:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:04.986861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.026948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:05.087323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8bb44-3d51-405b-b9b3-9e4850293812 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.121676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.122338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.122621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.122903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.123667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:05.123972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:05.125325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:05.134729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 613/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:54:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:05.140556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.191157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:05.241329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea637925-a604-4669-8cd5-061542c9e01e None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.275067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.275878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.276164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.276439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.286608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:05.288145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:05.305116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:05.306114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:05.307032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:05.307032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:05.307032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:05.307032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:05.307890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 597/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:05.313684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.409136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:05.412783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4bf97-998b-4b1d-922f-960cabab99dd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.453339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.453998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.454287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.454563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.455274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:05.455599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:05.456951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:05.468039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 614/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:54:05.473961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.576485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662fc29-bfec-4f28-adb7-67135df1f7ff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.577898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:05.609989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.610793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.611077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.611354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.618214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:05.619664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:05.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:05.635302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:05.641174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 598/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:05.641918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.740148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd4efe-8568-4fb3-aabb-5fe217ab4ffb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.773180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.773840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.774123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.774398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.775221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:05.775525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:05.776966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:05.794795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 615/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:05.800603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:05.899224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47874715-9ff4-4d5d-906f-235a7207e595 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:05.932156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:05.932798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:05.933085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:05.933373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:05.964002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.000993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.002442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.100994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 599/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:54:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 05:54:06.106925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:06.125578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.205343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde488-0661-4af6-92c4-07eee4a3d8b1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:06.240117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:06.240904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:06.241188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:06.241465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:06.251212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.252662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:06.269987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:06.273046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:06.274161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:06.274161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:06.274161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:06.274161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:06.274161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 616/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:06.277663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:06.338959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.376853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2e75a-5806-4c12-a95a-03478a6361c2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:06.409401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:06.410062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:06.410430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:06.410711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:06.412072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:06.412377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.413732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.425329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 600/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:06.431122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:06.501501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.530947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38450-118e-4421-883e-5c03fc233600 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:06.564059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:06.564839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:06.565122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:06.565398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:06.572526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.573948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:06.587911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:06.588997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:06.589954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 617/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:06.594873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:06.692200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46d7174-6b1d-4d3c-9980-3b7013c91aa8 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:06.715177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.726447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:06.727130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:06.727418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:06.727728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:06.728511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:06.728821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.730235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1468ea3e-2260-4de6-a0a8-75a9e34eb14d None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.741577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 601/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:06.747744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:06.848983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3b2e1-0082-4ab1-9b1f-aded3364b607 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:06.875577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:06.882078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:06.882725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:06.883013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:06.883288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:06.884153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=df158bb2f58b492d825a7b77ff35d9da) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:06.884480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:06.885875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5601c9c-d33f-46c6-97f6-ec58c78ea1fa None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:06.896099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 618/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:54:06 2022] GET /identity/v3/role_assignments?user.id=df158bb2f58b492d825a7b77ff35d9da&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:08.890628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c256-8041-404f-89c4-e4328170e6c6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:08.891174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c256-8041-404f-89c4-e4328170e6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:08.891279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03c256-8041-404f-89c4-e4328170e6c6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:08.892697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 602/1220] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:08.898697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:08.899179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:08.899283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:08.915910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:08.917091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:08.984743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 619/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:09.007740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c256-8041-404f-89c4-e4328170e6c6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.110767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03c256-8041-404f-89c4-e4328170e6c6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.144755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.145583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.145912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.146194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.156538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:09.165917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:09.167019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:09.168378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 603/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:09.173609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.270093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449319cf-3bc3-429c-bbe6-68e3f4221e69 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.294858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:09.305640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.306300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.306581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.306855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.307610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:09.307940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:09.309281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:09.316943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 620/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:09.322743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.367171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:09.422345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a87918-5bf9-469a-854b-ab3f93c3c963 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.456029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.456823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.457108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.457383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.467883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:09.469336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:09.487256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:09.488174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:09.489093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:09.489093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:09.489093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:09.489093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:09.489093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 604/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:09.494593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.594283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bd7c-88b6-439f-bd72-9806a5562717 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.626136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.626797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.627082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.627355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.628094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:09.628400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:09.630274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:09.642349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 621/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:09.648777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.741056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:09.748040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57cca-7ee4-4866-a409-1cbf37120049 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.781585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.782374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.782662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.782942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.789944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:09.791385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:09.806727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:09.807921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:09.814039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 605/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:09.814771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:09.860793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:09.912614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a87bd-9bfd-48a2-962e-f0ad6976b3d1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:09.947276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:09.947976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:09.948259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:09.948536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:09.949368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:09.949675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:09.951099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:09.968818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 622/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:09.975087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:10.077967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002129bb-f375-4b2c-b2ac-041d3a4a8672 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:10.112421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:10.113268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:10.113556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:10.113839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:10.124473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:10.130467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:10.144433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:10.145621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:10.146631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:10.146631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:10.146631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:10.146631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:10.146631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 606/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:54:10.152943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:10.250205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2242d-eb1a-47c9-9e15-6d16b6949145 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:10.252435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:10.282443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:10.283095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:10.283377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:10.283685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:10.284394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:10.284696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:10.286073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:10.302136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 623/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:10.303488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:10.312198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:10.401496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28ce96-b156-4838-a6e7-84d87bc041cc None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:10.436232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:10.437024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:10.437311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:10.437603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:10.444595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:10.446043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:10.460258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:10.461388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:10.462548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 607/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:10.467443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:10.567899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526630b-8dfe-4e8b-9a44-77d7f7eaff70 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:10.601492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:10.602154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:10.602442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:10.602723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:10.603503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:10.603846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:10.605275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7e30d-c156-4f08-b5ec-b29e993834e8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:10.617950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 624/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:10.624046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:10.691347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:10.725583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf824161-3f1c-42c3-ae21-4e755bd84c6b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:10.758806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:10.759722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:10.760010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:10.760291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/df158bb2f58b492d825a7b77ff35d9da/roles/902fcdc4be094c82b1e16e9251198ec2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:10.774569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=df158bb2f58b492d825a7b77ff35d9da, role_id=902fcdc4be094c82b1e16e9251198ec2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:10.776054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989762c9-496a-4e31-9918-a02b3742610e None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:10.839792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 608/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:54:10 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/df158bb2f58b492d825a7b77ff35d9da/roles/902fcdc4be094c82b1e16e9251198ec2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:54:12.850186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207803c-406f-4f47-9f71-7cc0b544947d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:12.850750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207803c-406f-4f47-9f71-7cc0b544947d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:12.850750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207803c-406f-4f47-9f71-7cc0b544947d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:12.852127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 625/1233] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:12.857179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:12.857637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:12.857736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:12.874495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:12.875741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:12.942984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 609/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:12.966415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207803c-406f-4f47-9f71-7cc0b544947d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:12.992009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:13.068821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207803c-406f-4f47-9f71-7cc0b544947d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.101880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.102607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.102891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.103169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.113128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:13.121495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:13.122610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:13.123675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 626/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jul 25 05:54:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:13.128794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:13.174602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:13.226532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f886c8-8a5f-45aa-bb80-75874a18ad40 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.260398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.261072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.261360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.261639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.262384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:13.262694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:13.264175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:13.272092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 610/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:13.277950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:13.363018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:13.378297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8c055-570c-47b9-a56f-411124dde51f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.409932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.410721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.411536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.411844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.422344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:13.423805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:13.441048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:13.442244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:13.443150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:13.443150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:13.443150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:13.443150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:13.443150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 627/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:13.448838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:13.549714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646259c4-ac8e-40ff-9623-569d1fabb7c9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.559800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:13.584227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.584883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.585166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.585478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.586230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:13.586535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:13.587919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:13.600233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 611/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:13.605917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:13.705836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598c397-7a25-438b-aed3-651fec28f1c9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.739966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.740798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.741121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.741393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.744118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:13.748983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:13.750381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:13.764703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:13.765647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:13.766743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 628/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:13.772456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:13.872286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7560b7ef-6af7-4ebd-b21a-7917ae1285ad None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:13.906212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:13.906874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:13.907160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:13.907440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:13.908301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:13.908612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:13.910014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:13.928832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 612/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:13.934805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.033773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c26b2e-1836-411a-9f65-d2cee952de32 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:14.068929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:14.069575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:14.069858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:14.070134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:14.130508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:14.137130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:14.138693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:14.236524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 629/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:54:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:54:14.242433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.269555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:14.341318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8821a360-4448-4169-b89e-bfb7a22a44c2 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:14.373582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:14.374366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:14.374648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:14.374920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:14.385504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:14.387024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:14.405411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:14.406489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:14.407612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:14.407612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:14.407612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:14.407612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:14.407612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 613/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:14.412698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.505723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:14.511366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa1f0f-4a23-4cdf-ab4a-801796935a0b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:14.544369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:14.545030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:14.545316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:14.545593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:14.546306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:14.546625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:14.548018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:14.559810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 630/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:54:14.565656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.643520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:14.664667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96643199-8b42-40c6-9696-c11ac7982435 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:14.698776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:14.699583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:14.699871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:14.700147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:14.706833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:14.708679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:14.722277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:14.724997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:14.725904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 614/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:54:14.729635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.834162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c170602-5ff2-4c74-b318-a7e8bf70570b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:14.867273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:14.867958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:14.868240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:14.868514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:14.869314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:14.869617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:14.871027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baff9ab-113d-4bbb-abc2-e9861c02e666 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:14.883272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 631/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:14.889534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:14.992631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b0943-3fd5-4d98-aad9-92b0bbf56151 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:15.026403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:15.027174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:15.027512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:15.027827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:15.028654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] RBAC: Adding query filter params (role.id=902fcdc4be094c82b1e16e9251198ec2, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=df158bb2f58b492d825a7b77ff35d9da) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:15.028966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:15.030394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bcd49-1be4-4818-b71f-ac1766515f01 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:15.036512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 615/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:54:14 2022] GET /identity/v3/role_assignments?user.id=df158bb2f58b492d825a7b77ff35d9da&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=902fcdc4be094c82b1e16e9251198ec2 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:17.142540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656599b-48d7-46d9-a4e7-417ba7a4d9c6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.143059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656599b-48d7-46d9-a4e7-417ba7a4d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.143173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656599b-48d7-46d9-a4e7-417ba7a4d9c6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.144487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 632/1247] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:17.151049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.162847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.162847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.162847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:17.169093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:17.170452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:17.237135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 616/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:17.261370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656599b-48d7-46d9-a4e7-417ba7a4d9c6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:17.279799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:17.363278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656599b-48d7-46d9-a4e7-417ba7a4d9c6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:17.397487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:17.398271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.398599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.398873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.408828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:17.416564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:17.417990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:17.419029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 633/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:17.424238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:17.523641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc7829-5af8-4a59-91b1-1d08765f881e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:17.553518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:17.558296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:17.559014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.559301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.559602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.563725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:17.563725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:17.563725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:17.570521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 617/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:17.576399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:17.652996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:17.674666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228f41f-92c6-495a-9abc-0b7d7fe2fcec None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:17.706934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:17.710441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.710441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.710441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.718818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:17.720278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:17.736951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:17.737994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:17.739725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:17.739725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:17.739725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:17.739725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:17.739725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 634/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:17.744489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:17.845256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40acd5bb-e5ff-4f8d-a6c5-697b4c6b3a46 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:17.878148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:17.878829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:17.879110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:17.879400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:17.880143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:17.880442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:17.881788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:17.893166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 618/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 05:54:17.899150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:17.999470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee8c88-793e-4448-b1b4-6eec451f7f35 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.027265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:18.035304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.037066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.041824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.041824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:18.045641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:18.047088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:18.061903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:18.063056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:18.064354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 635/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:18.068964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:18.123820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:18.166314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705891dd-19b4-4d28-9515-b91471d5def4 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.199228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.199920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.200208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.200487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:18.201314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:18.201629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:18.203034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:18.220190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 619/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:18.226771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:18.326881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa6ddd-4cdc-49ae-933e-2fc128007001 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.360798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.361444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.361731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.362013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:18.418091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:18.430168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:18.431656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:18.529100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 636/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:54:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:54:18.535183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:18.634067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4b8ff8-8738-4c74-8502-7e40bf561936 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.647376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:18.668138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.668929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.669219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.669499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:18.679330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:18.680817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:18.698579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:18.699744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:18.701101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:18.701101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:18.701101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:18.701101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:18.701101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 620/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:18.705563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:18.792815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:18.804743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a466ff84-a049-408e-8a9c-bea22d87389f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.838645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.839295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.839595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.839871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:18.840576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:18.840878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:18.842260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:18.853551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 637/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:18.859223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:18.958911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929b52e-3bcd-4cea-93ec-69591bb735b5 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:18.992773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:18.993550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:18.993831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:18.994109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:19.000647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:19.002090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:19.016157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:19.017247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:19.018330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 621/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:19.023314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:19.122733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b25c447-eeec-49a6-944e-c3760aa2aea2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:19.168914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:19.169651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:19.169939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:19.170216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:19.170997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:19.171307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:19.172766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d8f6b-2e93-47c8-ac49-50f4e239ae5c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:19.185339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 638/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:19.191544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:19.219152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:19.293330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4bc482-83ae-4c0d-9da0-48d34acbc366 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:19.327212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:19.327900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:19.328187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:19.328467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:19.329289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=df158bb2f58b492d825a7b77ff35d9da) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:19.329601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:19.331019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3c98e-93c7-4ce7-8213-64204d96c076 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:19.336391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 622/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:54:19 2022] GET /identity/v3/role_assignments?user.id=df158bb2f58b492d825a7b77ff35d9da&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:21.335023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad2af9-8314-4ea6-8fbc-e55eed755869 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:21.335545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad2af9-8314-4ea6-8fbc-e55eed755869 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:21.335740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad2af9-8314-4ea6-8fbc-e55eed755869 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:21.337152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 639/1261] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:21.342420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:21.342836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:21.342974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:21.360311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:21.361505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:21.427071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 623/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:21.450168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad2af9-8314-4ea6-8fbc-e55eed755869 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:21.461792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:21.553537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad2af9-8314-4ea6-8fbc-e55eed755869 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:21.587687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:21.588398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:21.588689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:21.588966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:21.599401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:21.606905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:21.608048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:21.609110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 640/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:21.614903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:21.632995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:21.713800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630e929-e267-4850-a9dc-75f80e6e3aa2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:21.748383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:21.749070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:21.749358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:21.749643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:21.750384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:21.750693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:21.752085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:21.760340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 624/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:21.766251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:21.833169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:21.867936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193122-9fd7-49a9-a554-e6d0ddbb37b8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:21.901864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:21.902642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:21.902923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:21.903277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:21.914289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:21.915753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:21.934475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:21.935584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:21.936861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:21.936861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:21.936861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:21.936861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:21.936861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 641/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:21.941762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.022192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:22.041542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec72b4-1ac8-4365-b434-084450b6199a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.076125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.076784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.077068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.077344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.078057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:22.078361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.079737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.091800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 625/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:22.097886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.200727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80eeaa-e294-4b5f-a2de-d8abd84eca1d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.220220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:22.234761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.235571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.235866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.236141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.243747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.245172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:22.259479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:22.262661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:22.263885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 642/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:22.266613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.370035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d76a3-ec6c-4d87-8e39-92c7d096fff9 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.403601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.404264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.404548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.404826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.405652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:22.405961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.407376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.417047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:22.425395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 626/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:22.430966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.530734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd262a95-0afc-441e-8b02-365793691029 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.564807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.565822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.566219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.566573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.578912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.580460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:22.598153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:22.599322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:22.600470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:22.600470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:22.600470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:22.600470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:22.600470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 643/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:22.605178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.704901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7758a-ad1a-4554-b89e-da4ea797a5b0 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.740057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.740791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.741095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.741375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.742093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:22.742399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.743781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.755369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 627/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:22.761098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.791697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:22.858321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34265043-f708-4f03-b4ff-67caf52cae27 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:22.893776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:22.894572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:22.894882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:22.895176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:22.901927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:22.903349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:22.916845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:22.918156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:22.919289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 644/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:22.925847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:22.984085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:23.027115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543ce00-748a-4dd5-8405-8831ffc6cd6f None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:23.062814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:23.063473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:23.068454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:23.068454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:23.068454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:23.068454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:23.068454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2651261c-bd3d-434d-8120-50ba31ecb30a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:23.079325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 628/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:23.086047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:23.178309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:23.186962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adf685-743d-4388-81f7-d1e566d3b0ae None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:23.220645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:23.221524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:23.221808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:23.222083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] PATH_INFO: `/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/df158bb2f58b492d825a7b77ff35d9da/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:23.224069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] RBAC: Authorizing `identity:create_grant(project_id=9336b33c78dd4132bfea7ecd02e3bfab, user_id=df158bb2f58b492d825a7b77ff35d9da, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:23.225658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7646-8803-4d71-9fbe-9b4b178acefa None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:23.353590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 645/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jul 25 05:54:23 2022] PUT /identity/v3/projects/9336b33c78dd4132bfea7ecd02e3bfab/users/df158bb2f58b492d825a7b77ff35d9da/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 05:54:25.357136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aeeda-9a49-40db-88e5-e5ca165ac4ee None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:25.357683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aeeda-9a49-40db-88e5-e5ca165ac4ee None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:25.357683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48aeeda-9a49-40db-88e5-e5ca165ac4ee None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:25.358998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 629/1274] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:25.364838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:25.365408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:25.365776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:25.383081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:25.386330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:25.450125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 646/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:25.474601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aeeda-9a49-40db-88e5-e5ca165ac4ee None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:25.576234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48aeeda-9a49-40db-88e5-e5ca165ac4ee None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:25.593975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:25.610605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:25.611330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:25.611675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:25.611974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:25.621987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 05:54:25.630210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:25.631350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:25.632372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 630/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jul 25 05:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 05:54:25.637512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:25.716526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:25.734489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b25c488-3c14-4ca1-ae8b-83e8c60c5311 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:25.767349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:25.768055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:25.768338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:25.768612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:25.769351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:25.769650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:25.771968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:25.779904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 647/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jul 25 05:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:25.786288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:25.886688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a158bea1-a352-435a-a0c7-6c2199d0641b None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:25.920518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:25.921308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:25.921590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:25.921864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:25.932922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:25.934352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:25.951818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:25.953035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:25.954358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:25.954358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:25.954358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:25.954358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:25.954358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 631/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:25.959770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:26.058474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400aa3a-9429-4963-a182-811328db94f2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:26.092249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:26.092911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:26.093199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:26.093478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:26.094195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:26.094503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:26.095888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:26.107420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 648/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:26.113056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:26.145376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:26.213680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65bd420-0dcb-46ca-8f52-7acfc6755045 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:26.245745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:26.246534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:26.246815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:26.247086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:26.253981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:26.255980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 05:54:26.270530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:26.272288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:26.273449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 632/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:26.278024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:26.281858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:26.373154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa8c04-b095-4636-a243-0badd278a131 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:26.408053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:26.408665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:26.408954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:26.409233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:26.410115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:26.410427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:26.411925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:26.429748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 649/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jul 25 05:54:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:26.435784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:26.524708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:26.534040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112a52a-36b2-4783-99c6-e0da66365cff None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:26.567547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:26.568746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:26.569027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:26.569305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:26.635809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:26.637238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:26.723181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:26.733238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 633/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jul 25 05:54:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 05:54:26.739004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:26.801353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:26.839947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448fb77-5551-44ac-802c-ef53e64724e4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:26.874474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:26.875258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:26.875543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:26.875858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:26.886723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:26.888191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 05:54:26.905381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:26.906416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:26.907503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 05:54:26.907503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 05:54:26.907503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 05:54:26.907503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:26.907503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 650/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 05:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:26.913022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:27.010083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2a238-a711-4b9a-936e-56d62a591f44 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:27.044772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:27.045442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:27.045731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:27.046012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:27.046848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:27.047161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:27.048581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:27.060983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 634/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jul 25 05:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:27.066717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:27.164479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3534b-697f-4db0-a7a9-698ee5d50db0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:27.178365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:27.197459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:27.198287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:27.198575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:27.198846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:27.205311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:27.206730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 05:54:27.222145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:27.226629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 25 05:54:27.227769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 651/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jul 25 05:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:27.230231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:27.280462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:27.329854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba138d95-a4ac-479e-a2a5-ef5bcd4c5d33 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:27.364865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e628410-0542-4abf-942c-6196178524ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:27.365696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e628410-0542-4abf-942c-6196178524ea None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:27.365982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e628410-0542-4abf-942c-6196178524ea None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:27.366260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e628410-0542-4abf-942c-6196178524ea None admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:27.367043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e628410-0542-4abf-942c-6196178524ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:27.367354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e628410-0542-4abf-942c-6196178524ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:27.368829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e628410-0542-4abf-942c-6196178524ea None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:27.381772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 635/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jul 25 05:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:27.387862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:27.487562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf4280-8ee6-485d-af5d-e1f3b1c158e4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:27.522310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:27.522959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:27.523247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:27.523527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:27.524386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] RBAC: Adding query filter params (role.id=9af7a97541544183a2fd12ef8ccb62b5, scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab, user.id=df158bb2f58b492d825a7b77ff35d9da) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:27.524696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:27.526114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2cf23-51a6-4328-9f74-74775fc8bf0d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:27.531962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 652/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jul 25 05:54:27 2022] GET /identity/v3/role_assignments?user.id=df158bb2f58b492d825a7b77ff35d9da&scope.project.id=9336b33c78dd4132bfea7ecd02e3bfab&role.id=9af7a97541544183a2fd12ef8ccb62b5 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:29.606132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bd93-3e70-4a1c-8892-2491fb5d1095 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:29.606666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bd93-3e70-4a1c-8892-2491fb5d1095 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:29.606666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce65bd93-3e70-4a1c-8892-2491fb5d1095 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:29.608072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 636/1288] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:29.613155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:29.613561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:29.613746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:29.630610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:29.631832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:29.662387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:29.698972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 653/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 05:54:29.721314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bd93-3e70-4a1c-8892-2491fb5d1095 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:29.822085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce65bd93-3e70-4a1c-8892-2491fb5d1095 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:29.832277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:29.855621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:29.856457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:29.856688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:29.856962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:29.857603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:29.859014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:29.871588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:29.872752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:29.873629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 637/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:54:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:29.878809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:29.975960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8d5de-0160-4ff3-992e-069298dc4d4c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:30.009275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:30.009934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:30.010219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:30.010497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:30.011194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:30.011499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:30.012883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4dec2-ae8e-4bbb-82f5-187cb472bad2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:30.017723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 654/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jul 25 05:54:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:30.023653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:30.123859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f2d99-d343-413b-bee4-1b868d9a32b7 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:30.156502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:30.157159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:30.157441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:30.157717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] PATH_INFO: `/v3/services` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:30.158443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:30.158749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:30.160140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a682-4e35-4235-8697-13ddab4bd21f None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:30.165233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 638/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jul 25 05:54:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:32.176986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c102a7-0f16-4e9b-810e-fc26cbfc183d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:32.177547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c102a7-0f16-4e9b-810e-fc26cbfc183d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:32.177974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c102a7-0f16-4e9b-810e-fc26cbfc183d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:32.179977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 655/1293] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:32.185155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba31fa-e56c-421d-9cf4-dde525610b0e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:32.185533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba31fa-e56c-421d-9cf4-dde525610b0e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:32.185720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba31fa-e56c-421d-9cf4-dde525610b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:32.202981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-deba31fa-e56c-421d-9cf4-dde525610b0e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:32.204200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-deba31fa-e56c-421d-9cf4-dde525610b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:32.233208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:32.269394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 639/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:32.293394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c102a7-0f16-4e9b-810e-fc26cbfc183d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:32.325180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:32.394123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c102a7-0f16-4e9b-810e-fc26cbfc183d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:32.430412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:32.431084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:32.431354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:32.431662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:32.432573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:32.433931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be460c9-1d37-49d5-a4c1-526593f346cf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:32.525429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 656/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jul 25 05:54:32 2022] POST /identity/v3/services => generated 246 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:54:34.581303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9c4b-a8b8-4fa4-9320-80e74f520a5b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:34.581853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9c4b-a8b8-4fa4-9320-80e74f520a5b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:34.581853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ee9c4b-a8b8-4fa4-9320-80e74f520a5b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:34.583236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 640/1296] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:34.589023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:34.589426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:34.589595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:34.606123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:34.607321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:34.680658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 657/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:34.704794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9c4b-a8b8-4fa4-9320-80e74f520a5b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:34.804128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ee9c4b-a8b8-4fa4-9320-80e74f520a5b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:34.839344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:34.840088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:34.840377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:34.840659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:34.841309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:34.842668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:34.854631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:34.860753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:34.861807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 641/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:54:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:34.862784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:34.881457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:34.958974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9374acc-98b9-402e-ade1-c7acdfa3b333 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:34.993274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:34.993933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:34.994217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:34.994491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:34.995198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:34.995505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:34.996880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:35.001956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 658/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jul 25 05:54:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:35.008927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:35.041262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:35.109986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ebb32-6b64-4720-9c18-f4240ab2f92a None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:35.142544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:35.143188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:35.143470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:35.143772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:35.144601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] RBAC: Adding query filter params (interface=public, service_id=76755bad1c8f41349cd263161be643f8, region_id=RegionOne) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:35.144914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:35.146263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc2a7c-4b57-4140-8a96-b1d1f239cf4a None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:35.151116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 642/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jul 25 05:54:35 2022] GET /identity/v3/endpoints?service_id=76755bad1c8f41349cd263161be643f8&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:35.156965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:35.238022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:35.256019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce39096-cd9f-4f79-8091-a3e99b6e6e8a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:35.290253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:35.290925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:35.291211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:35.291488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:35.292466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:35.293878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91024e4-188c-4a36-a49d-32fab0a9fb0f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:35.300733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 659/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jul 25 05:54:35 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 05:54:37.402081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338eb89-88e8-419e-928b-54397d789dd3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:37.402862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338eb89-88e8-419e-928b-54397d789dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:37.402862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338eb89-88e8-419e-928b-54397d789dd3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:37.403946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 643/1302] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 05:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 05:54:37.410355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:37.410821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:37.410916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:37.428713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 05:54:37.429906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 05:54:37.505080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 660/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 05:54:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 05:54:37.530947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338eb89-88e8-419e-928b-54397d789dd3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:37.643325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:37.650864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338eb89-88e8-419e-928b-54397d789dd3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:37.691613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:37.692441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:37.692938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:37.694023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:37.694981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:37.696972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 25 05:54:37.710469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 05:54:37.711539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application with Lock( Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self._enter() Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application return self.creator() Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application created_value = creator( Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: ERROR keystone.server.flask.application Jul 25 05:54:37.712686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 644/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jul 25 05:54:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 05:54:37.717897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:37.810089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:37.834625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c627b2-84e8-46d9-9390-bb2b879696b0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:37.871886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:37.872591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:37.872877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:37.873253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:37.873874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 05:54:37.874185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:37.875597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ace7-7941-412c-91a5-23f8ff341bf1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:37.881603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 661/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jul 25 05:54:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 05:54:37.888733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 05:54:38.005245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39fb94e-3714-4fb9-b593-b9262c7c0a75 None admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 05:54:38.038947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 05:54:38.039630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 05:54:38.039921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 05:54:38.040201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 05:54:38.040940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 05:54:38.042576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbda9ba-5afa-413b-afd8-4d985e7c2c31 None admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 05:54:38.135178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 645/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jul 25 05:54:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 05:54:47.900649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=30 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 05:54:48.129926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:41.891757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a713-1580-4107-8e38-c192f0e2fe65 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:41.892296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a713-1580-4107-8e38-c192f0e2fe65 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:41.892296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a713-1580-4107-8e38-c192f0e2fe65 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:41.893648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 662/1307] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:41.899295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8b51-850c-41da-880b-d3d499cf3a54 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:41.899295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8b51-850c-41da-880b-d3d499cf3a54 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:41.899931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe8b51-850c-41da-880b-d3d499cf3a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:41.973676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-abfe8b51-850c-41da-880b-d3d499cf3a54 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:41.974844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-abfe8b51-850c-41da-880b-d3d499cf3a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:42.087108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 646/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:42.140971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:42.140971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:42.140971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:42.141638 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 663/1309] 10.222.0.36 () {54 vars in 965 bytes} [Mon Jul 25 06:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:42.162565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b51b1-c420-4605-b427-3adb0106628f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:42.162867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b51b1-c420-4605-b427-3adb0106628f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:42.163183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b51b1-c420-4605-b427-3adb0106628f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:42.281452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9e1b51b1-c420-4605-b427-3adb0106628f None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:42.282675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9e1b51b1-c420-4605-b427-3adb0106628f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:42.308143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:42.366656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 647/1310] 10.222.0.36 () {58 vars in 1062 bytes} [Mon Jul 25 06:00:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:42.377527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:42.379608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:42.516539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde4bf1-add5-4c67-9cea-5c0c3be51fe1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:42.594890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:42.595949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:42.596387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:42.596815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:42.598748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:42.657181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:42.716348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:42.718128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32c162-1f8e-42f6-9777-856d00c163de service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:42.739237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 664/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:45.187675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:45.188231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:45.188231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:45.189765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 648/1312] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:45.194757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daea0-26de-4bd9-990d-ee614dc7bc36 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:45.195173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daea0-26de-4bd9-990d-ee614dc7bc36 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:45.195338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daea0-26de-4bd9-990d-ee614dc7bc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:45.280772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-276daea0-26de-4bd9-990d-ee614dc7bc36 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:45.281985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-276daea0-26de-4bd9-990d-ee614dc7bc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:45.383615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 665/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:45.423298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:45.425047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:45.545280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dc9af-fdf9-4de3-b887-a713cc182b82 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:45.628151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:45.631304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:45.632130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:45.632524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:45.632903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:45.634843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:45.763601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:45.765047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d004b6-14ab-4fe2-9cf4-349b4ee22b73 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:45.783797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 649/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:48.309791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:48.310317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:48.310317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:48.311683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 666/1315] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:48.316702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041acb-d9f3-49bc-8f8f-94c7e4e48560 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:48.317073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041acb-d9f3-49bc-8f8f-94c7e4e48560 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:48.317258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb041acb-d9f3-49bc-8f8f-94c7e4e48560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:48.381555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bb041acb-d9f3-49bc-8f8f-94c7e4e48560 None None] MFA Rules not processed for user `dfecdb7e62f643c1b9699f84f4b27372`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:48.382765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bb041acb-d9f3-49bc-8f8f-94c7e4e48560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:48.435581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:48.478703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 650/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:48.518636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:48.520203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:48.533612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:48.628533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e46d-e76f-4b83-b0ad-9ea8940387eb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:48.700431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:48.701067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:48.701351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:48.701628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:48.703268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:48.764755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:48.811765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:48.813193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64bee50-4d02-4dbc-9313-7551dee842a7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:48.830754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 667/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:52.037587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:52.038137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:52.038137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:52.039608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 651/1318] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:52.044999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f9da-175b-4fd5-9308-4eb00d6727e0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:52.045414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f9da-175b-4fd5-9308-4eb00d6727e0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:52.045565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423f9da-175b-4fd5-9308-4eb00d6727e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:52.109090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4423f9da-175b-4fd5-9308-4eb00d6727e0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:52.110292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4423f9da-175b-4fd5-9308-4eb00d6727e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:52.204916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 668/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:52.243835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:52.245339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:52.347260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948e521-fc58-4f02-80e5-b5035c4f8776 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:52.418609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:52.419364 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:52.419680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:52.419965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:52.421611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:52.428912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:52.531510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:52.532885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604892a-9b96-4903-a8f3-c8f28fb47001 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:52.550697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 652/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:55.619929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:55.620508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:55.620508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:55.622562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 669/1321] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:55.627911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180e41-fab5-4bc9-a75a-84747eac597b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:55.628342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180e41-fab5-4bc9-a75a-84747eac597b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:55.628485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4180e41-fab5-4bc9-a75a-84747eac597b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:55.694534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c4180e41-fab5-4bc9-a75a-84747eac597b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:55.695792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c4180e41-fab5-4bc9-a75a-84747eac597b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:55.754362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:55.796338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 653/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:55.833716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:55.835418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:55.857144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:55.946904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b14215-f6b9-44e4-947b-14dbfc5eb51f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:56.024390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:56.025040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:56.025322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:56.025595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:56.027217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:56.101878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:56.142437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:56.143896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a2134-3bb7-4da5-8df3-79494faac917 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:56.162062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 670/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:00:58.268508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:58.269026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:58.269026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:58.270355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 654/1324] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:00:58.275485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466aa8-0ff3-45fd-a241-8778ec355ae4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:58.275918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466aa8-0ff3-45fd-a241-8778ec355ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:58.276072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d466aa8-0ff3-45fd-a241-8778ec355ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:58.340336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4d466aa8-0ff3-45fd-a241-8778ec355ae4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:00:58.341448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4d466aa8-0ff3-45fd-a241-8778ec355ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:58.439404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 671/1325] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:00:58.480822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:00:58.482383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:58.587296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77588fc-2055-4dac-883e-7c0b4262af70 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:00:58.662890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:00:58.663544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:00:58.663858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:00:58.664143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:00:58.665802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:00:58.682632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:00:58.782350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:00:58.783926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a24a3-c09a-492d-9f92-815117124db2 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:00:58.801972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 655/1326] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:00.902154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:00.902833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:00.902956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:00.904430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 672/1327] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:00.910264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2c0c6-c231-4407-99f3-608c04a44618 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:00.910696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2c0c6-c231-4407-99f3-608c04a44618 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:00.910897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2c0c6-c231-4407-99f3-608c04a44618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:00.976179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-aea2c0c6-c231-4407-99f3-608c04a44618 None None] MFA Rules not processed for user `dfecdb7e62f643c1b9699f84f4b27372`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:00.977382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aea2c0c6-c231-4407-99f3-608c04a44618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:01.047258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:01.080437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 656/1328] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:01.118476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:01.120089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:01.154471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:01.226100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c46f1b-5355-4d87-8d6e-a3c16f2050eb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:01.299493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:01.300100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:01.300388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:01.300669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:01.302342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:01.384177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:01.415686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:01.417166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18263096-9340-4cd7-93f9-d18f4bc18c3a service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:01.436916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 673/1329] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:03.983450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ffd1e-5fda-4e61-871e-a97a8b77b1e0 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:03.984046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ffd1e-5fda-4e61-871e-a97a8b77b1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:03.984046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ffd1e-5fda-4e61-871e-a97a8b77b1e0 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:03.985444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 657/1330] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:03.990546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152ab0-7b0d-40b0-97d6-8c2c6a1c35c5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:03.990953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152ab0-7b0d-40b0-97d6-8c2c6a1c35c5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:03.991116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9152ab0-7b0d-40b0-97d6-8c2c6a1c35c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:04.060800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b9152ab0-7b0d-40b0-97d6-8c2c6a1c35c5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:04.062000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b9152ab0-7b0d-40b0-97d6-8c2c6a1c35c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:04.161456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 674/1331] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:04.213606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:04.213889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:04.214166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:04.215724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 658/1332] 10.222.0.36 () {54 vars in 965 bytes} [Mon Jul 25 06:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:04.221472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cb1e-e561-4905-8acd-0e765a1c81ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:04.221762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cb1e-e561-4905-8acd-0e765a1c81ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:04.222067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2cb1e-e561-4905-8acd-0e765a1c81ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:04.265440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:04.295222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0fb2cb1e-e561-4905-8acd-0e765a1c81ff None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:04.296433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0fb2cb1e-e561-4905-8acd-0e765a1c81ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:04.373138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 675/1333] 10.222.0.36 () {58 vars in 1062 bytes} [Mon Jul 25 06:01:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:04.381858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:04.383388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:04.486977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaca3f-f5e7-419b-93f9-b3161d748739 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:04.561937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:04.562509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:04.562795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:04.563074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:04.564766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:04.590492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:04.671322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:04.672766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4998d05-51f4-4bfe-96ff-f3b0df87b1f2 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:04.691536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 659/1334] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:06.990732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:06.991286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:06.991286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:06.992698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 676/1335] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:06.998084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a7c3-2514-4a8e-942e-3d0fa8fc5a35 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:06.998474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a7c3-2514-4a8e-942e-3d0fa8fc5a35 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:06.998658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6a7c3-2514-4a8e-942e-3d0fa8fc5a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:07.064023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-45b6a7c3-2514-4a8e-942e-3d0fa8fc5a35 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:07.065244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-45b6a7c3-2514-4a8e-942e-3d0fa8fc5a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:07.137617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:07.160202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 660/1336] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:07.200546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:07.202094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:07.305422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4700ece-31c7-44f6-a157-b65fc9dcd487 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:07.334425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:07.378989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:07.379661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:07.379946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:07.380221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:07.381879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:07.491158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:07.492609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bc7659-14c9-4eb4-aefc-148a220e73e3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:07.510933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 677/1337] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:01:10.379707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:10.380215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:10.380215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:10.381595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 661/1338] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:10.386660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ccfd4-9b4a-4ee3-86f8-d9c135ba84be None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:10.387260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ccfd4-9b4a-4ee3-86f8-d9c135ba84be None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:10.387260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ccfd4-9b4a-4ee3-86f8-d9c135ba84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:10.452096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-275ccfd4-9b4a-4ee3-86f8-d9c135ba84be None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:10.453284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-275ccfd4-9b4a-4ee3-86f8-d9c135ba84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:10.461434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:10.550380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 678/1339] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:10.586804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:10.588362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:10.690381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a9471-6416-4462-a2ad-302b3ce2ee26 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:10.762114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:10.762763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:10.763051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:10.763333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:10.765078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:10.801508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:10.873290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:10.874726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afdcf15-0218-4b83-bbf6-0861951c78be service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:10.892782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 662/1340] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:15.201221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:15.201745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:15.201857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:15.207173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 679/1341] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:15.209205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701330e-869a-4177-93c2-45c320d05bba None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:15.209667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701330e-869a-4177-93c2-45c320d05bba None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:15.209776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701330e-869a-4177-93c2-45c320d05bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:15.283687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7701330e-869a-4177-93c2-45c320d05bba None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:15.284927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7701330e-869a-4177-93c2-45c320d05bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:15.376799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:15.389032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 663/1342] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:01:15.428228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:15.429738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:15.537307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc684333-5c64-4da5-b643-2a0960a79447 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:15.578212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:15.616221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:15.616867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:15.617151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:15.617427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:15.619058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:15.730906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:15.732380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2ec58-8fab-4b96-ba6b-ef9faa5a6ef1 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:15.751987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 680/1343] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:18.828796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:18.829302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:18.829302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:18.830646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 664/1344] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:18.835987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838181-ae2d-4d08-ba2c-140a5f380878 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:18.836384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838181-ae2d-4d08-ba2c-140a5f380878 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:18.836632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15838181-ae2d-4d08-ba2c-140a5f380878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:18.901226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15838181-ae2d-4d08-ba2c-140a5f380878 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:18.903251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15838181-ae2d-4d08-ba2c-140a5f380878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:18.921189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:19.001021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 681/1345] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:19.040170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:19.041763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:19.148053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d68560-4242-4b32-af2d-556fd8b519ca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:19.223128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:19.223817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:19.224104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:19.224384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:19.226120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:19.273931 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:19.339726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:19.341284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda80814-b554-4da4-bd42-c33cab309270 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:19.361591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 665/1346] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:23.818173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:23.818692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:23.818889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:23.820152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 682/1347] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:23.826079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d90bf-e455-4f80-b1e9-98351fc3339c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:23.826579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d90bf-e455-4f80-b1e9-98351fc3339c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:23.826682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d90bf-e455-4f80-b1e9-98351fc3339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:23.895770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-aa9d90bf-e455-4f80-b1e9-98351fc3339c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:23.896992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aa9d90bf-e455-4f80-b1e9-98351fc3339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:23.993517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:23.996788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 666/1348] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:24.036629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:24.037984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:24.147632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8dc25d-da1a-4e3b-be89-aa3d8379e736 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:24.196896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:24.223919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:24.224568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:24.224851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:24.225124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:24.226758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:24.336998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:24.338442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bee353-ef8a-469e-913f-4fd52aab9698 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:24.358697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 683/1349] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:01:29.239595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec93f47-c3d1-409c-b6ae-4609f993694e None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:29.239595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec93f47-c3d1-409c-b6ae-4609f993694e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:29.239595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec93f47-c3d1-409c-b6ae-4609f993694e None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:29.241886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 667/1350] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:29.246872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13f20-17fd-416f-9024-f49485d4b018 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:29.247317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13f20-17fd-416f-9024-f49485d4b018 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:29.247423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a13f20-17fd-416f-9024-f49485d4b018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:29.328845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-03a13f20-17fd-416f-9024-f49485d4b018 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:29.330055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-03a13f20-17fd-416f-9024-f49485d4b018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:29.355888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:29.493220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 684/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:01:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:33.680365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d28fa8-28d0-4a14-8a67-bc47c97d65d5 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:33.680894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d28fa8-28d0-4a14-8a67-bc47c97d65d5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:33.681007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d28fa8-28d0-4a14-8a67-bc47c97d65d5 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:33.682310 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 668/1352] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:33.687654 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248b9ae-163c-4b0b-884e-0c8e3649ce68 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:33.688105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248b9ae-163c-4b0b-884e-0c8e3649ce68 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:33.688424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248b9ae-163c-4b0b-884e-0c8e3649ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:33.765679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8248b9ae-163c-4b0b-884e-0c8e3649ce68 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:33.766878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8248b9ae-163c-4b0b-884e-0c8e3649ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:33.840009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:33.877194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 685/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:01:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:35.246242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adb90-94f6-4049-8640-2352ccb35fc8 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:35.246763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adb90-94f6-4049-8640-2352ccb35fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:35.246956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adb90-94f6-4049-8640-2352ccb35fc8 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:35.248397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 669/1354] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:35.253824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4941-9cd0-4654-b51e-3c1b9830f603 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:35.254226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4941-9cd0-4654-b51e-3c1b9830f603 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:35.254393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93be4941-9cd0-4654-b51e-3c1b9830f603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:35.330819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-93be4941-9cd0-4654-b51e-3c1b9830f603 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:35.331987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-93be4941-9cd0-4654-b51e-3c1b9830f603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:35.439413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 686/1355] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:01:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:38.889570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a968-2ed7-419e-bb22-964ccecc9ce2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:38.890404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a968-2ed7-419e-bb22-964ccecc9ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:38.890842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a968-2ed7-419e-bb22-964ccecc9ce2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:38.896377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 670/1356] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:38.898502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028ad8-19e8-4999-8d05-663349ef0b54 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:38.899291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028ad8-19e8-4999-8d05-663349ef0b54 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:38.899754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b028ad8-19e8-4999-8d05-663349ef0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:38.953802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:38.986505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5b028ad8-19e8-4999-8d05-663349ef0b54 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:38.988713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5b028ad8-19e8-4999-8d05-663349ef0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:39.111722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 687/1357] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:39.166279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:39.166566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:39.166831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:39.170230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 671/1358] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jul 25 06:01:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:39.180742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb55e-3cb0-4699-b836-025c1f4d0008 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:39.181036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb55e-3cb0-4699-b836-025c1f4d0008 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:39.181318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb55e-3cb0-4699-b836-025c1f4d0008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:39.265070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ccfeb55e-3cb0-4699-b836-025c1f4d0008 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:39.266303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ccfeb55e-3cb0-4699-b836-025c1f4d0008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:39.320310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:39.391359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 688/1359] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jul 25 06:01:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:39.399623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:39.401217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:39.558178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b72799-d3ba-413e-997a-cf79a33b6ce6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:39.638279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:39.680245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:39.680949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:39.681195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:39.681446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:39.684511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:39.782119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:39.783742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4911e-4f13-42cd-832e-ef347d0f273f service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:39.803099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 672/1360] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:42.096698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:42.097281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:42.097281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:42.098546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 689/1361] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:42.104086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf13f-5efd-4cdd-bfed-8817b521ac33 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:42.104541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf13f-5efd-4cdd-bfed-8817b521ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:42.104921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bf13f-5efd-4cdd-bfed-8817b521ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:42.173567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5e2bf13f-5efd-4cdd-bfed-8817b521ac33 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:42.174921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5e2bf13f-5efd-4cdd-bfed-8817b521ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:42.215615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:42.282737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 673/1362] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:42.332413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:42.334191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:42.516425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6575e-f5be-4b6a-aa9d-74f2b31b18df None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:42.527401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:42.675093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:42.675801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:42.676092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:42.676377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:42.678122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:42.776868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:42.778875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378f7a1-ee7f-4ac4-8287-b75700fd0e03 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:42.798146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 690/1363] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:45.388228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365162-1049-4329-b38e-ca8e517ee04a None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:45.388744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365162-1049-4329-b38e-ca8e517ee04a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:45.388744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94365162-1049-4329-b38e-ca8e517ee04a None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:45.390087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 674/1364] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:01:45.395749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f072-0274-4c9d-a9cc-1920511dd01a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:45.396170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f072-0274-4c9d-a9cc-1920511dd01a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:45.396346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9f072-0274-4c9d-a9cc-1920511dd01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:45.412669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:45.470849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-68b9f072-0274-4c9d-a9cc-1920511dd01a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:45.472481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-68b9f072-0274-4c9d-a9cc-1920511dd01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:45.583965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 691/1365] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:45.633482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:45.633865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:45.634221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:45.636401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 675/1366] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jul 25 06:01:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:45.643657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c76ac-1f5b-4997-8879-92a475638b8b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:45.643657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c76ac-1f5b-4997-8879-92a475638b8b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:45.643657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c76ac-1f5b-4997-8879-92a475638b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:45.726619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6b8c76ac-1f5b-4997-8879-92a475638b8b None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:45.727868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6b8c76ac-1f5b-4997-8879-92a475638b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:45.765843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:45.857330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 692/1367] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jul 25 06:01:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:45.865353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:45.866874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:46.025554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8ea54-c7fb-493d-b71e-9d052782518b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:46.055354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:46.153396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:46.154318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:46.154606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:46.154887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:46.156599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:46.251043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:46.252814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14558-4b50-4089-92b2-7b79b68d1f70 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:46.272872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 676/1368] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:01:47.256055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b442b-3748-439f-abe5-6c5819ddea2a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:47.256623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b442b-3748-439f-abe5-6c5819ddea2a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:47.256623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b442b-3748-439f-abe5-6c5819ddea2a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:47.258162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 693/1369] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:47.263902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d52a-c0c7-4aee-8da3-4c24d9b8e31b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:47.264323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d52a-c0c7-4aee-8da3-4c24d9b8e31b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:47.264498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75d52a-c0c7-4aee-8da3-4c24d9b8e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:47.296625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:47.333331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-be75d52a-c0c7-4aee-8da3-4c24d9b8e31b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:47.334541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-be75d52a-c0c7-4aee-8da3-4c24d9b8e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:47.438137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 677/1370] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:01:47.785760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:47.786052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:47.786327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:47.787870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 694/1371] 10.222.0.36 () {54 vars in 964 bytes} [Mon Jul 25 06:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:47.793385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81b30-be1f-482c-9383-be5d7fa7fb08 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:47.793785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81b30-be1f-482c-9383-be5d7fa7fb08 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:47.794169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede81b30-be1f-482c-9383-be5d7fa7fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:47.874538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ede81b30-be1f-482c-9383-be5d7fa7fb08 None None] MFA Rules not processed for user `1f429ab936824983b32150cd5c181210`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:47.875938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ede81b30-be1f-482c-9383-be5d7fa7fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:47.924785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:47.956105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 678/1372] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Jul 25 06:01:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:47.964262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:47.966060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:48.090602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc48e22-02c1-4301-a4bf-7b8695786196 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:48.131620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:48.165855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:48.166512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:48.167438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:48.167755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:48.170153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:48.283903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:48.285168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d8e23-1692-4d71-afe2-ecea40ef3aa6 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:48.305336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 695/1373] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:48.528191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:48.528951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:48.529150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:48.530534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 679/1374] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:48.535775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1265-4e13-4d46-bc66-0615c78c3089 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:48.536080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1265-4e13-4d46-bc66-0615c78c3089 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:48.536362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f1265-4e13-4d46-bc66-0615c78c3089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:48.615903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cf7f1265-4e13-4d46-bc66-0615c78c3089 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:48.617234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cf7f1265-4e13-4d46-bc66-0615c78c3089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:48.643021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:48.736168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 696/1375] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:48.778620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:48.780181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:48.938415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1d4ba-60cd-4b03-aa58-81a9d6c56f48 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:48.991891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:49.054867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:49.055512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:49.055823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:49.056100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:49.058277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:49.149942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:49.151671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3999cd-857a-42ba-a90d-1b8f7390325a service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:49.169937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 680/1376] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:51.393105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:51.393640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:51.393640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:51.395039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 697/1377] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:51.400634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f81a-3de6-4c5a-b646-4b41770b05db None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:51.401625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f81a-3de6-4c5a-b646-4b41770b05db None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:51.401734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450f81a-3de6-4c5a-b646-4b41770b05db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:51.473844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5450f81a-3de6-4c5a-b646-4b41770b05db None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:51.475116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5450f81a-3de6-4c5a-b646-4b41770b05db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:51.484514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:51.589006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 681/1378] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:51.632871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:51.634513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:51.794433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eee859-bb5d-4bbb-aa59-7b431209e259 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:51.798055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:51.934923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:51.939673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:51.939673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:51.939673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:51.942682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:52.074784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:52.077295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ef01c-d180-41e8-afba-c8663f8eb976 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:52.099599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 698/1379] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:54.294223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:54.294745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:54.294854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:54.296500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 682/1380] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:54.301649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0cc8-f052-4176-b514-36a7c2a25ef0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:54.302112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0cc8-f052-4176-b514-36a7c2a25ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:54.302210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4b0cc8-f052-4176-b514-36a7c2a25ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:54.313195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:54.374374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3a4b0cc8-f052-4176-b514-36a7c2a25ef0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:54.375588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3a4b0cc8-f052-4176-b514-36a7c2a25ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:54.483957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 699/1381] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:54.523547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:54.525094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:54.675833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:54.687826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a830262-ef90-43e8-bedf-32d11a446d8f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:54.812636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:54.813408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:54.813715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:54.813992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:54.815687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:54.930225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:54.932044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f244e33d-cbb1-4812-b26e-6d38022f3230 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:54.943337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:54.952409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 683/1382] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:57.176042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:57.176711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:57.176711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:57.177990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 700/1383] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:01:57.184148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5f99-1674-4875-8f96-93ba41689105 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:57.184666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5f99-1674-4875-8f96-93ba41689105 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:57.184839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f5f99-1674-4875-8f96-93ba41689105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:57.253314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-426f5f99-1674-4875-8f96-93ba41689105 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:57.254619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-426f5f99-1674-4875-8f96-93ba41689105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:57.356317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 684/1384] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:01:57.399251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:01:57.401326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:57.490858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:57.553016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862e6ac-fdda-4d1e-9ee1-4ac8078508fb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:01:57.669257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:01:57.669829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:57.670112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:57.670384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:57.672080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:01:57.722771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:01:57.764297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:01:57.765906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac1cd4-90d0-4cdc-9b50-e903461328fd service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:01:57.785023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 701/1385] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:01:59.834127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:59.834841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:59.834841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:59.836087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 685/1386] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:01:59.841982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d2a-e8b0-4822-be62-3bfd3ccafad0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:01:59.842476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d2a-e8b0-4822-be62-3bfd3ccafad0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:01:59.842476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad3d2a-e8b0-4822-be62-3bfd3ccafad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:01:59.918332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8fad3d2a-e8b0-4822-be62-3bfd3ccafad0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:01:59.919704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8fad3d2a-e8b0-4822-be62-3bfd3ccafad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:00.024346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 702/1387] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:00.073284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:00.075017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:00.162556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:00.237702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae882f-5044-40b0-9ef7-c661f7481fab None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:00.357363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:00.358009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:00.358298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:00.358617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:00.360262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:00.398933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:00.455177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:00.456715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd99d9c8-2905-412a-8826-afea8d990c9a service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:00.475196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 686/1388] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:02.859088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:02.859880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:02.859880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:02.861203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 703/1389] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:02.866519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6f2d-52ac-4d70-a54a-f2dd0270cfac None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:02.866963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6f2d-52ac-4d70-a54a-f2dd0270cfac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:02.867146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca6f2d-52ac-4d70-a54a-f2dd0270cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:02.932136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a9ca6f2d-52ac-4d70-a54a-f2dd0270cfac None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:02.933326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a9ca6f2d-52ac-4d70-a54a-f2dd0270cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:03.034077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 687/1390] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:03.081746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:03.083340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:03.114134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:03.230741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7305cd-68a0-4830-924c-8659fb8f6f81 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:03.334674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:03.347010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:03.347707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:03.347993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:03.348271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:03.349909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:03.440886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:03.442408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a91541-388e-4082-9eb3-2d55ecefb299 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:03.460285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 704/1391] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:03.744232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852859be-1b71-4dd2-a6f3-ac2b097d32af None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:03.744538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852859be-1b71-4dd2-a6f3-ac2b097d32af None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:03.744840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852859be-1b71-4dd2-a6f3-ac2b097d32af None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:03.746395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 688/1392] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:03.752264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc15d-2a42-41cf-98b1-faa8654dd264 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:03.752566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc15d-2a42-41cf-98b1-faa8654dd264 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:03.752850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bc15d-2a42-41cf-98b1-faa8654dd264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:03.821982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d93bc15d-2a42-41cf-98b1-faa8654dd264 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:03.823757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d93bc15d-2a42-41cf-98b1-faa8654dd264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:03.881971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:03.921216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 705/1393] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:03.976985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:03.977428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:03.977526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:03.979078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 689/1394] 10.222.0.36 () {54 vars in 966 bytes} [Mon Jul 25 06:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:03.984485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5169-3fd3-4a71-a511-aea1b91cca2d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:03.984804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5169-3fd3-4a71-a511-aea1b91cca2d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:03.985110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef5169-3fd3-4a71-a511-aea1b91cca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:04.073051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-63ef5169-3fd3-4a71-a511-aea1b91cca2d None None] MFA Rules not processed for user `ed6cf63615e341518b142f986915e404`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:04.074451 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-63ef5169-3fd3-4a71-a511-aea1b91cca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:04.163278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 706/1395] 10.222.0.36 () {58 vars in 1063 bytes} [Mon Jul 25 06:02:03 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:04.171144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:04.172706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:04.187800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:04.291927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc18dbd-b71c-4108-8e69-c61f674b4054 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:04.368154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:04.368811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:04.369130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:04.369963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:04.371795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:04.442609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:04.486308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:04.487756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7a4f-207a-4c74-a861-4c4c0f43223b service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:04.506089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 690/1396] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:02:05.363741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc92b-ddb7-4c28-83fb-bbab60d0c849 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.364232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc92b-ddb7-4c28-83fb-bbab60d0c849 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.364338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc92b-ddb7-4c28-83fb-bbab60d0c849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.432857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-220cc92b-ddb7-4c28-83fb-bbab60d0c849 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:05.434066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-220cc92b-ddb7-4c28-83fb-bbab60d0c849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:05.442445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:05.524124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 707/1397] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:02:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:05.571849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a06cf-3505-46e6-83e8-e0a0992344f3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.572371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a06cf-3505-46e6-83e8-e0a0992344f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.573091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a06cf-3505-46e6-83e8-e0a0992344f3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.574587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 691/1398] 10.222.0.36 () {54 vars in 943 bytes} [Mon Jul 25 06:02:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:05.581551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f268-6650-422a-b788-471871b65593 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.581843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f268-6650-422a-b788-471871b65593 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.582121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f268-6650-422a-b788-471871b65593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.657214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8f56f268-6650-422a-b788-471871b65593 None None] MFA Rules not processed for user `064b2b59c734411e81c488d505deb560`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:05.658318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8f56f268-6650-422a-b788-471871b65593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:05.693823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cc532-0860-4fc8-95a9-6a1261b388bd None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.694115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cc532-0860-4fc8-95a9-6a1261b388bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.694400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cc532-0860-4fc8-95a9-6a1261b388bd None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.695844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 692/1399] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:02:05.701615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.701908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.702192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.744950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:05.767277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 708/1400] 10.222.0.36 () {58 vars in 1040 bytes} [Mon Jul 25 06:02:05 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:05.770032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:05.771313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:05.776833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f268-6650-422a-b788-471871b65593 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:05.786555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f268-6650-422a-b788-471871b65593 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:05.872297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 693/1401] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:02:05.894689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:05.895350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:05.895692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:05.895976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:05.897661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:05.917852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:05.918999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:05.946621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:05.983919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:05.985518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d2369-f13e-4f86-94f6-e521744670d4 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:05.993923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 709/1402] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:02:06.038628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96472842-e71a-4a81-b5d6-ec5626a4cb06 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:06.150585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:06.151393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:06.151708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:06.151988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:06.153880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:06.171877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:06.247335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:06.248977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a8aec-1aa2-496b-9aa2-002c111cb592 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:06.266699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 694/1403] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:08.553742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:08.553742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:08.553742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:08.559605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 710/1404] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:02:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:08.561168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66f9a-6e38-4dea-b1d5-9ab88bb890eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:08.561595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66f9a-6e38-4dea-b1d5-9ab88bb890eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:08.561733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab66f9a-6e38-4dea-b1d5-9ab88bb890eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:08.638041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3ab66f9a-6e38-4dea-b1d5-9ab88bb890eb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:08.639183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3ab66f9a-6e38-4dea-b1d5-9ab88bb890eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:08.741557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:08.748440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 695/1405] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:08.793244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:08.794785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:08.804845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:08.963720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2486f-1099-4930-bfda-f9a4f5c92c75 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:09.066404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:09.107491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:09.108186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:09.108573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:09.109002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:09.110717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:09.209337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:09.211818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352257c1-f5aa-49f1-93e0-fc2d1189e01b service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:09.234355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 711/1406] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:11.570576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:11.571163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:11.571163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:11.575929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 696/1407] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:02:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:11.577803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1489-6be9-48e9-bc37-38b79faecdda None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:11.578252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1489-6be9-48e9-bc37-38b79faecdda None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:11.578389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1489-6be9-48e9-bc37-38b79faecdda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:11.648931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8dbc1489-6be9-48e9-bc37-38b79faecdda None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:11.651617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8dbc1489-6be9-48e9-bc37-38b79faecdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:11.704988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:11.771612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 712/1408] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:11.809860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:11.811520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:11.990475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26d43b-cf7e-45de-b01c-b43f689f5e30 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:12.070757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:12.124444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:12.125102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:12.125390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:12.125659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:12.127464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:12.227710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:12.230034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5020197-92c1-4e91-b43e-260cfe595953 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:12.249559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 697/1409] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:21.761384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=23 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:22.246564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=64 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:29.097436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3749-d304-4a8c-822e-07347f204064 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:29.097977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3749-d304-4a8c-822e-07347f204064 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:29.098115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3749-d304-4a8c-822e-07347f204064 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:29.099389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 713/1410] 10.222.0.36 () {54 vars in 918 bytes} [Mon Jul 25 06:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:29.104722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13511d-3d63-4f18-ac9a-14cdfd669eee None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:29.105151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13511d-3d63-4f18-ac9a-14cdfd669eee None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:29.105285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe13511d-3d63-4f18-ac9a-14cdfd669eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:29.180462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fe13511d-3d63-4f18-ac9a-14cdfd669eee None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:29.181750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fe13511d-3d63-4f18-ac9a-14cdfd669eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:29.286788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 698/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 25 06:02:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:29.300884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76a82-7d8d-4bf0-9279-0a86a6c6212a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:29.301116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76a82-7d8d-4bf0-9279-0a86a6c6212a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:29.301394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e76a82-7d8d-4bf0-9279-0a86a6c6212a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:29.302746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 714/1412] 10.222.0.36 () {54 vars in 918 bytes} [Mon Jul 25 06:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:29.307689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f8e2-d647-4a8a-b8dd-e2ed3b15c871 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:29.307979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f8e2-d647-4a8a-b8dd-e2ed3b15c871 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:29.308258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a9f8e2-d647-4a8a-b8dd-e2ed3b15c871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:29.378606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:29.381110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-19a9f8e2-d647-4a8a-b8dd-e2ed3b15c871 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:29.382314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-19a9f8e2-d647-4a8a-b8dd-e2ed3b15c871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:29.500315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 699/1413] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jul 25 06:02:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:02:31.995894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:31.996439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:31.996439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:31.997799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:32.003222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223e6d-258c-484a-96f5-6d33c395b6ab None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:32.003673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223e6d-258c-484a-96f5-6d33c395b6ab None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:32.003824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15223e6d-258c-484a-96f5-6d33c395b6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:32.070219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-15223e6d-258c-484a-96f5-6d33c395b6ab None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:32.071427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-15223e6d-258c-484a-96f5-6d33c395b6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:32.125566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:32.166737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:32.209108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:32.210622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:32.355445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a5cd7-2056-47e1-b6d8-2a084a6e9c95 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:32.428051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:32.469667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:32.470347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:32.470635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:32.470917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:32.472631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:32.561435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:32.563017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0ffe35-3b48-4de8-a253-b84de01b04de service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:32.582658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 716/1416] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:33.488181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:33.488724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:33.488825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:33.490140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:33.495931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3d9f-c5c6-4de3-97aa-3461fd096aba None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:33.496337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3d9f-c5c6-4de3-97aa-3461fd096aba None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:33.496484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef3d9f-c5c6-4de3-97aa-3461fd096aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:33.571456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2cef3d9f-c5c6-4de3-97aa-3461fd096aba None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:33.572797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2cef3d9f-c5c6-4de3-97aa-3461fd096aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:33.599232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:33.670102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:33.820774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:33.822775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:33.970530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afaf08-f771-4462-9a90-9670aa513002 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:34.010625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:34.084527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:34.085120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:34.085404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:34.085680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:34.087322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:34.176462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:34.178071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62415567-c473-4b09-b063-bfaf482624f2 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:34.195875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 702/1419] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:35.074080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:35.074600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:35.074790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:35.076065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:35.081104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629eef9-1a3c-401f-8284-fed7079cae7a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:35.081519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629eef9-1a3c-401f-8284-fed7079cae7a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:35.081673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629eef9-1a3c-401f-8284-fed7079cae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:35.135741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:35.157510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3629eef9-1a3c-401f-8284-fed7079cae7a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:35.159331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3629eef9-1a3c-401f-8284-fed7079cae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:35.256790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:02:35.407379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:35.408786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:35.555988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7194e9-d11c-4f66-93c6-97df3e5260d1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:35.568462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:35.669486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:35.670063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:35.670351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:35.670631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:35.672315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:35.760850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:35.762444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5fb89-33df-4c6d-86b8-5ccb548591f3 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:35.780502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 719/1422] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:36.640741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:36.641306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:36.641306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:36.642682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:36.647714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2eee5-d62f-45e1-8a4f-f2586d528d8d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:36.648176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2eee5-d62f-45e1-8a4f-f2586d528d8d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:36.648310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2eee5-d62f-45e1-8a4f-f2586d528d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:36.667575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:36.723809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-59f2eee5-d62f-45e1-8a4f-f2586d528d8d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:36.724998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-59f2eee5-d62f-45e1-8a4f-f2586d528d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:36.818573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:36.974130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:36.975616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:37.085178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:37.121692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3605c47-45ee-47c4-8660-66cdc8684242 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:37.233835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:37.234518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:37.234801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:37.235076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:37.236756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:37.314282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:37.327669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:37.329286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8228854-a3dd-4213-96b2-4e0474ca48f1 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:37.347448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 705/1425] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:38.211334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:38.211929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:38.211929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:38.213784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:38.218751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb561da-7271-4005-84e4-829b631ef13b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:38.219174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb561da-7271-4005-84e4-829b631ef13b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:38.219346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb561da-7271-4005-84e4-829b631ef13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:38.294674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4fb561da-7271-4005-84e4-829b631ef13b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:38.296021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4fb561da-7271-4005-84e4-829b631ef13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:38.392067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:38.543002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:38.544543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:38.631601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:38.693233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1ac9b-bb02-426d-8d18-5505c439865b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:38.804563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:38.805209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:38.805493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:38.805785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:38.807698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:38.858233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:38.899985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:38.902532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f053db68-7a75-4482-97d3-b336cd6a05e5 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:38.920494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 722/1428] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:39.820723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:39.821313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:39.821313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:39.822738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:39.827734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228c66-f6e1-48a9-a363-128fda0a0c87 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:39.828142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228c66-f6e1-48a9-a363-128fda0a0c87 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:39.828301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff228c66-f6e1-48a9-a363-128fda0a0c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:39.902359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ff228c66-f6e1-48a9-a363-128fda0a0c87 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:39.903585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ff228c66-f6e1-48a9-a363-128fda0a0c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:39.999859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:40.160528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:40.161988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:40.329713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:40.427259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c8aa-a000-4e38-96d6-f83986092638 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:40.538903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:40.539584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:40.539864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:40.540142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:40.542293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:40.549106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:40.629980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:40.631584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261968f4-3007-4db1-bf6b-115d8c7fdd7c service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:40.649636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 708/1431] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:41.545217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:41.545753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:41.545753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:41.547154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:41.552194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5cd-89c6-4ff6-836c-ab40dfb9be59 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:41.552599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5cd-89c6-4ff6-836c-ab40dfb9be59 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:41.552794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598c5cd-89c6-4ff6-836c-ab40dfb9be59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:41.627090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c598c5cd-89c6-4ff6-836c-ab40dfb9be59 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:41.628255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c598c5cd-89c6-4ff6-836c-ab40dfb9be59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:41.697661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:41.726070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:41.877765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:41.879243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:41.896749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:42.027809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c542d-81f3-43ff-8446-5d00e7c58a32 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:42.115798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:42.266303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:42.266959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:42.267246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:42.267523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:42.269207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:42.359574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:42.361157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5466e-83d6-4b6a-a740-8b614135c864 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:42.379333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 725/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:02:43.258745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:43.259373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:43.260150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:43.261720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:43.266550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237845-45c6-4373-b16b-2d31652f7dc2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:43.266981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237845-45c6-4373-b16b-2d31652f7dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:43.267112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37237845-45c6-4373-b16b-2d31652f7dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:43.340396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-37237845-45c6-4373-b16b-2d31652f7dc2 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:43.341512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-37237845-45c6-4373-b16b-2d31652f7dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:43.383299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:43.438395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:43.588493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:43.590017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:43.739375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a93374-ae09-4d2e-8f51-6a53ab706628 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:43.794557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:43.852663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:43.853511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:43.853796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:43.854075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:43.855751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:43.943181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:43.944789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5398a67c-7fdb-45ce-8438-4b3bb9135eae service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:43.963439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 711/1437] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:44.832157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:44.832744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:44.832744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:44.834102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:44.839823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664d35b-5595-4a03-896c-f51bd3516a5a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:44.840235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664d35b-5595-4a03-896c-f51bd3516a5a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:44.840369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664d35b-5595-4a03-896c-f51bd3516a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:44.916895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b664d35b-5595-4a03-896c-f51bd3516a5a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:44.918117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b664d35b-5595-4a03-896c-f51bd3516a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:44.920148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:45.014881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:45.164820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:45.166835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:45.312214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7e3e-93fd-4b48-aa79-045d34a8d37c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:45.339908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:45.425906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:45.426478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:45.426757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:45.427029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:45.428696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:45.516690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:45.518306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ec6a-7f25-4a34-b20e-183708f7f3ff service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:45.536640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 728/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:47.546480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:47.547045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:47.547045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:47.548472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:47.553899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f003b56-27e6-4471-8058-3a5fd82ac5eb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:47.554305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f003b56-27e6-4471-8058-3a5fd82ac5eb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:47.554468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f003b56-27e6-4471-8058-3a5fd82ac5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:47.594355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:47.619443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0f003b56-27e6-4471-8058-3a5fd82ac5eb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:47.620667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0f003b56-27e6-4471-8058-3a5fd82ac5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:47.717367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:47.755666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:47.757193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:47.859809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3891a03-927b-4633-af31-f941f4d1dc7f None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:47.891526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:47.934303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:47.934949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:47.935237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:47.935515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:47.937211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:48.045565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:48.047032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c369b-7260-47d8-9cb3-f138f6662a75 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:48.065920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 714/1443] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:50.264997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:50.265575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:50.265575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:50.266941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:50.272164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8d73-9346-437f-b9bf-27522b839e05 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:50.272607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8d73-9346-437f-b9bf-27522b839e05 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:50.272760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a8d73-9346-437f-b9bf-27522b839e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:50.337716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a80a8d73-9346-437f-b9bf-27522b839e05 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:50.339151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a80a8d73-9346-437f-b9bf-27522b839e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:50.351733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:50.436978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:50.475434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:50.477119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:50.579997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0265b5d-ebbe-4558-a024-0d80bfe2cdfc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:50.592597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:50.653559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:50.654202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:50.654487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:50.654766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:50.656431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:50.763579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:50.765009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc36376-cb4a-4549-a32d-9e0e7b8741c3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:50.783703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 731/1446] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:53.172374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:53.172923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:53.172923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:53.174301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:53.179458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932363-e78d-49ad-a1ac-0e5392a46c7d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:53.179926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932363-e78d-49ad-a1ac-0e5392a46c7d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:53.180032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2932363-e78d-49ad-a1ac-0e5392a46c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:53.226288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:53.245492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b2932363-e78d-49ad-a1ac-0e5392a46c7d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:53.246680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b2932363-e78d-49ad-a1ac-0e5392a46c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:53.344636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:53.384709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:53.386291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:53.487961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc05055-ab14-4ee8-a121-664cab344547 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:53.527386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:53.560284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:53.560936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:53.561398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:53.561713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:53.563851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:53.670367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:53.671744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56daa8-ab1f-4921-b9f7-92cd3da8b02c service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:53.689476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 717/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:55.921916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:55.922486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:55.922486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:55.923890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:02:55.929346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20dbed-3dff-402e-a402-6f7a796c31b3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:55.929761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20dbed-3dff-402e-a402-6f7a796c31b3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:55.929908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20dbed-3dff-402e-a402-6f7a796c31b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:55.995990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4d20dbed-3dff-402e-a402-6f7a796c31b3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:55.997210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4d20dbed-3dff-402e-a402-6f7a796c31b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:56.017847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:56.095253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:56.135373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:56.136976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:56.239030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14116a5c-d2af-40d3-b661-fd1065ec111f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:56.258876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:56.313107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:56.313778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:56.314059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:56.314331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:56.316008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:56.423640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:56.425071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c0ce4-0143-4857-bfe3-efa8e6acf4f7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:56.443832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 734/1452] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:02:58.529598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:58.530129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:58.530252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:58.531572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:02:58.536825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472ea0-c3f4-4e7f-80f5-434e7d57c2ec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:58.537238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472ea0-c3f4-4e7f-80f5-434e7d57c2ec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:58.537397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9472ea0-c3f4-4e7f-80f5-434e7d57c2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:58.599743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:58.602959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d9472ea0-c3f4-4e7f-80f5-434e7d57c2ec None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:02:58.604246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d9472ea0-c3f4-4e7f-80f5-434e7d57c2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:58.701658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:02:58.739606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:02:58.741160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:58.844320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c4aa0e-34bf-4fd5-974a-5edf6bd034d6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:02:58.892440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:02:58.918886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:02:58.919538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:02:58.919854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:02:58.920140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:02:58.921794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:02:59.035819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:02:59.037254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb5f5e-713a-433d-a663-1d13a04aa635 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:02:59.056298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 720/1455] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:01.177297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:01.177823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:01.177932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:01.179223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:01.184726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b61f-325f-4e78-897f-5ff65c66fcca None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:01.185150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b61f-325f-4e78-897f-5ff65c66fcca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:01.185331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9b61f-325f-4e78-897f-5ff65c66fcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:01.253808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a0a9b61f-325f-4e78-897f-5ff65c66fcca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:01.255077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a0a9b61f-325f-4e78-897f-5ff65c66fcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:01.284966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:01.352808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:01.391861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:01.393430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:01.496340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636073b-27b7-4a61-b68c-e1996503ad91 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:01.523787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:01.570185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:01.570831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:01.571331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:01.571957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:01.573595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:01.683066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:01.684537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad3172-54be-4de5-a30b-555ad17bd266 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:01.703735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 737/1458] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:03.783578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b54-103c-4803-a677-171b782823f2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:03.784144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b54-103c-4803-a677-171b782823f2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:03.784144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e1b54-103c-4803-a677-171b782823f2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:03.785560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:03.791691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080a6c-6c82-40de-8c79-e1c894bbe724 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:03.792106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080a6c-6c82-40de-8c79-e1c894bbe724 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:03.792280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20080a6c-6c82-40de-8c79-e1c894bbe724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:03.857517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-20080a6c-6c82-40de-8c79-e1c894bbe724 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:03.858711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-20080a6c-6c82-40de-8c79-e1c894bbe724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:03.866948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:03.957854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:03.995991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1b54-103c-4803-a677-171b782823f2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:03.997549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-982e1b54-103c-4803-a677-171b782823f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:04.102154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e1b54-103c-4803-a677-171b782823f2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:04.158336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:04.177217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:04.177860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:04.178139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:04.178408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:04.180061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:04.287637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:04.289071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6efc3-59f5-4eb1-a706-88dffcbbac2d service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:04.307458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 723/1461] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:06.388178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:06.388733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:06.388733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:06.390025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:06.395192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879d4b-4836-4feb-a49d-bed657e4919a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:06.395734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879d4b-4836-4feb-a49d-bed657e4919a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:06.395846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50879d4b-4836-4feb-a49d-bed657e4919a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:06.459652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-50879d4b-4836-4feb-a49d-bed657e4919a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:06.460863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-50879d4b-4836-4feb-a49d-bed657e4919a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:06.498886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:06.556756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:06.593613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:06.595151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:06.696604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cc261-73de-4e46-8096-e93503be0acb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:06.733394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:06.769400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:06.770047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:06.770333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:06.770613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:06.772278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:06.880054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:06.881476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906e6d3-968c-463a-ac1a-7d48fa1d1e3b service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:06.900777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 740/1464] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:08.957064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:08.957665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:08.957665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:08.959078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:08.964549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe60c-f76f-4087-ac11-2eed7f3ec185 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:08.964987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe60c-f76f-4087-ac11-2eed7f3ec185 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:08.965111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffe60c-f76f-4087-ac11-2eed7f3ec185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:09.035332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-72ffe60c-f76f-4087-ac11-2eed7f3ec185 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:09.036587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-72ffe60c-f76f-4087-ac11-2eed7f3ec185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:09.056399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:09.140621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:09.178143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:09.179755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:09.283049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6de926-3287-4be1-a236-0bfd6404e132 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:09.349970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:09.356860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:09.357505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:09.361043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:09.361043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:09.361043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:09.469304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:09.470747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df8b71b-00f8-44d2-81c3-492ee8412d2c service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:09.488991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 726/1467] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:11.539761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809e81-d321-43f9-9c63-2251c585836a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:11.540499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809e81-d321-43f9-9c63-2251c585836a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:11.540499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21809e81-d321-43f9-9c63-2251c585836a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:11.541710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:11.546946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0df8-bd5d-4b97-b85a-1c8083b1b2c7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:11.547325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0df8-bd5d-4b97-b85a-1c8083b1b2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:11.547512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e0df8-bd5d-4b97-b85a-1c8083b1b2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:11.612406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ae1e0df8-bd5d-4b97-b85a-1c8083b1b2c7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:11.613538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ae1e0df8-bd5d-4b97-b85a-1c8083b1b2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:11.660818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:11.709105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:11.745669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809e81-d321-43f9-9c63-2251c585836a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:11.747206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-21809e81-d321-43f9-9c63-2251c585836a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:11.850036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21809e81-d321-43f9-9c63-2251c585836a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:11.896933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:11.923205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:11.923878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:11.924172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:11.924472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:11.926105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:12.036836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:12.038276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b63e4c-d1f3-493e-bec0-f92b5cb08694 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:12.058426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 743/1470] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:03:21.710571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=22 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:22.055847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=66 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:31.900079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419b60-f199-4530-9c95-a8a267ee5c3f None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:31.900925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419b60-f199-4530-9c95-a8a267ee5c3f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:31.900925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419b60-f199-4530-9c95-a8a267ee5c3f None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:31.902250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 728/1471] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:31.907594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1992621-8959-42fe-8441-31cf994ac085 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:31.908010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1992621-8959-42fe-8441-31cf994ac085 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:31.908153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1992621-8959-42fe-8441-31cf994ac085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:31.973583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c1992621-8959-42fe-8441-31cf994ac085 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:31.974788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c1992621-8959-42fe-8441-31cf994ac085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:32.072987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 744/1472] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:32.156535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:32.156831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:32.157115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:32.158477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 729/1473] 10.222.0.36 () {54 vars in 966 bytes} [Mon Jul 25 06:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:32.163371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df327-49d5-45c8-9f0f-b71c239625c5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:32.163693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df327-49d5-45c8-9f0f-b71c239625c5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:32.164503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df327-49d5-45c8-9f0f-b71c239625c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:32.238424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-456df327-49d5-45c8-9f0f-b71c239625c5 None None] MFA Rules not processed for user `ed6cf63615e341518b142f986915e404`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:32.239669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-456df327-49d5-45c8-9f0f-b71c239625c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:32.260559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:32.316684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 745/1474] 10.222.0.36 () {58 vars in 1063 bytes} [Mon Jul 25 06:03:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:32.324373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:32.325906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:32.429390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16b637-eeaf-46ab-b5b6-3e781e321e28 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:32.502039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:32.502692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:32.502981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:32.503263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:32.504955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:32.559573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:32.613280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:32.614708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986fe6f-d76b-41f8-9886-83779fdf05a5 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:32.634185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 730/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:34.751739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:34.752352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:34.752352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:34.753725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 746/1476] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:34.759178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ce8-5e22-4075-9086-322ce275eb90 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:34.759631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ce8-5e22-4075-9086-322ce275eb90 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:34.759768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a04ce8-5e22-4075-9086-322ce275eb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:34.823701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e6a04ce8-5e22-4075-9086-322ce275eb90 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:34.824913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e6a04ce8-5e22-4075-9086-322ce275eb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:34.921769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 731/1477] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:34.945103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:34.946703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:35.074295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feaf88c-c7aa-4e0d-a54d-254810938258 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:35.124602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:35.171616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:35.172278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:35.172563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:35.172841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:35.173559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:35.175291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:03:35.175291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:03:35.175291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:03:35.176459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a45c2-a503-4559-871e-49db5b155274 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:35.194828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 747/1478] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jul 25 06:03:34 2022] GET /identity/v3/projects => generated 2553 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:03:37.259991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:37.260546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:37.260546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:37.261928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 732/1479] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:37.267107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e568b-cbff-49a8-87a1-73c696c1315e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:37.267490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e568b-cbff-49a8-87a1-73c696c1315e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:37.267718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e568b-cbff-49a8-87a1-73c696c1315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:37.333159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-251e568b-cbff-49a8-87a1-73c696c1315e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:37.334295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-251e568b-cbff-49a8-87a1-73c696c1315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:37.429378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 748/1480] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:37.473185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:37.474709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:37.485208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:37.620197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf3bd7-7168-426c-afcc-f5a329b8681c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:37.700634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:37.733678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:37.734328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:37.734613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:37.734891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:37.736577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:37.824454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:37.826023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d74f7a-b58e-41b0-9322-e642d885491f service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:37.844257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 733/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:40.052673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:40.053163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:40.053262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:40.055187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 749/1482] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:40.060544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f53-6b22-4d90-b315-bad08fb3c48a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:40.060953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f53-6b22-4d90-b315-bad08fb3c48a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:40.061105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e664f53-6b22-4d90-b315-bad08fb3c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:40.124963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8e664f53-6b22-4d90-b315-bad08fb3c48a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:40.126181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8e664f53-6b22-4d90-b315-bad08fb3c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:40.172073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:40.222423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 734/1483] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:40.259623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:40.261171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:40.284582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:40.365253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f547aa3-5ea4-45b6-aa09-f4017c1241a2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:40.439454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:40.440130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:40.440415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:40.440700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:40.442415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:40.515385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:40.549679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:40.551390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766ee95-0d9f-41cc-816a-126b125454ae service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:40.570312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 750/1484] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:42.651203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:42.651761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:42.651761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:42.653107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 735/1485] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:42.658212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ba2e-e41c-4a11-a294-2bfec996104b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:42.658619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ba2e-e41c-4a11-a294-2bfec996104b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:42.658770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300ba2e-e41c-4a11-a294-2bfec996104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:42.721664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9300ba2e-e41c-4a11-a294-2bfec996104b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:42.722848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9300ba2e-e41c-4a11-a294-2bfec996104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:42.818196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 751/1486] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:42.857347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:42.858999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:42.961689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939d4a7-3553-4d76-a2f9-a68150cb1d2d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:43.033741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:43.035520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:43.036200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:43.036485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:43.036762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:43.038419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:43.145977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:43.147421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d23c9f-3dfb-43d5-a4ff-a72b5ff7eaa7 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:43.167354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 736/1487] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:45.377948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:45.378497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:45.378497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:45.379886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 752/1488] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:45.385598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cbfc7-d55c-4b42-85d9-465f03505561 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:45.386006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cbfc7-d55c-4b42-85d9-465f03505561 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:45.386164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cbfc7-d55c-4b42-85d9-465f03505561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:45.450630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-820cbfc7-d55c-4b42-85d9-465f03505561 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:45.451887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-820cbfc7-d55c-4b42-85d9-465f03505561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:45.504443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:45.550067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 737/1489] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:45.591538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:45.593102 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:45.629142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:45.696888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c4289-5a4a-442e-9a40-3dbe99620fd7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:45.769393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:45.770039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:45.770322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:45.770597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:45.772253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:45.852885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:45.882090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:45.883747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1072f2-361a-462d-8092-9eef205f761e service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:45.902489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 753/1490] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:48.440839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:48.441350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:48.441350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:48.442669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 738/1491] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jul 25 06:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:03:48.448679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85271-5d99-4bfb-8ef1-06e4aa40f514 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:48.449094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85271-5d99-4bfb-8ef1-06e4aa40f514 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:48.449242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e85271-5d99-4bfb-8ef1-06e4aa40f514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:48.512598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c6e85271-5d99-4bfb-8ef1-06e4aa40f514 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:03:48.513789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c6e85271-5d99-4bfb-8ef1-06e4aa40f514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:48.608084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 754/1492] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jul 25 06:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:03:48.646879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:03:48.649173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:48.750356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017da2d5-acd5-4476-83d1-119353b890ac None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:03:48.823826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:03:48.824462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:03:48.824749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:03:48.825023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:03:48.826666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:03:48.836189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:48.935665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:03:48.937105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6831-1a3d-4adf-9f0f-7717b9df661c service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:03:48.955921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 739/1493] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:03:58.606313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:03:58.953548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=50 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:30.151526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:30.152114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:30.152114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:30.227280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:05:30.228537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:30.324480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 755/1494] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:05:30.332317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:30.332813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:30.332918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:30.407648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:05:30.408849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:30.505267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 740/1495] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:05:30.509869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:30.511073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:30.522999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705cffd-0b84-4972-ad1d-b0a34c234579 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:30.585155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:30.619082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:30.619783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:30.620088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:30.620345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:30.621063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:05:30.621368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:30.622373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:30.622373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:05:30.622373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:05:30.623256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:30.635372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 756/1496] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:05:30.643641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:30.653235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7238a-45e2-437a-b4ac-224d92042671 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:30.713843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:30.747713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:30.748365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:30.748647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:30.748922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:30.749634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:30.752212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:30.752212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:05:30.752212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:05:30.753399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:30.888515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 741/1497] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:05:30 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:05:30.892650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:30.894207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:30.929733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a5814-ce58-437b-80a1-7ae309ba958e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:31.023487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:31.024189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.024474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.024751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.025438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:31.026436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:31.026436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:05:31.026436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:05:31.027663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:31.123284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 757/1498] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:05:30 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:05:31.127303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:31.128878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:31.190166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fd20c-604f-4e4d-85f5-1c3c19627f5a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:31.273922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:31.284104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:31.284778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.285067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.285346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.286065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:31.287078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:31.287078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:05:31.287078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:05:31.287990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:31.300244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 742/1499] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:05:31.304406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:31.305944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:31.317320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f56afd-8a8d-471e-a83f-e2c675f53cb9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:31.343450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:31.413751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:31.414334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.414617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.414892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.415647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:31.416671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:31.416671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:05:31.416671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:05:31.417555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4fd7e-5ac1-4bbc-8734-02ddba5c5510 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:31.429937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 758/1500] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:05:31.434154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:31.435800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:31.470028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e3fa2-c31a-4dbb-a348-9bbe4529a99a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:31.566008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:31.569351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.569351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.569351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] PATH_INFO: `/v3/projects/9eb01fd3abdd4ad7ad14819aa60adcdf/users/1316c2b848934f7ca8204128d68fca9f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.590829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb01fd3abdd4ad7ad14819aa60adcdf, user_id=1316c2b848934f7ca8204128d68fca9f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:31.591897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:31.591897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:05:31.591897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:05:31.593841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c2c081-b712-4e18-8ab2-5b939308f70b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:31.669396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 743/1501] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:05:31 2022] PUT /identity/v3/projects/9eb01fd3abdd4ad7ad14819aa60adcdf/users/1316c2b848934f7ca8204128d68fca9f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:05:31.682180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc8a2-9550-429c-aa5e-6b9af4726775 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.682469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc8a2-9550-429c-aa5e-6b9af4726775 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.682749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dc8a2-9550-429c-aa5e-6b9af4726775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.737877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a50dc8a2-9550-429c-aa5e-6b9af4726775 None None] MFA Rules not processed for user `1316c2b848934f7ca8204128d68fca9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:05:31.739083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a50dc8a2-9550-429c-aa5e-6b9af4726775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:31.815902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 759/1502] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:05:31.829589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.829886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.830174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.831573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 744/1503] 10.222.0.36 () {54 vars in 964 bytes} [Mon Jul 25 06:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:05:31.836392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7e42-b35b-46ce-bd1e-ad9acb3407fc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:31.836686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7e42-b35b-46ce-bd1e-ad9acb3407fc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:31.836968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df7e42-b35b-46ce-bd1e-ad9acb3407fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:31.866590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:31.911480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d5df7e42-b35b-46ce-bd1e-ad9acb3407fc None None] MFA Rules not processed for user `1f429ab936824983b32150cd5c181210`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:05:31.912956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d5df7e42-b35b-46ce-bd1e-ad9acb3407fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:31.987999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 760/1504] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Jul 25 06:05:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:05:31.999760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:32.001289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:32.052275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:32.106412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d4ee71-f573-4a96-bb9a-ebd59fa080b2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:32.180295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:32.180942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:32.181228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:32.181504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:32.183143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:32.281732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:32.283085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:32.286589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:32.301989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 745/1505] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:05:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:05:32.344598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ad62-759a-431a-b5a9-0548fbe0058b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:32.345051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ad62-759a-431a-b5a9-0548fbe0058b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:32.345147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187ad62-759a-431a-b5a9-0548fbe0058b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:32.346404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 761/1506] 10.222.0.36 () {52 vars in 829 bytes} [Mon Jul 25 06:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:05:32.350467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:32.351714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:32.449474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6c9ee-88be-4580-87ce-c54900e55ab6 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:32.544574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:32.545380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:32.545664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:32.545941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] PATH_INFO: `/v3/users/1316c2b848934f7ca8204128d68fca9f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:32.558216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1316c2b848934f7ca8204128d68fca9f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:32.559233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:32.559233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:05:32.559233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:05:32.560475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:32.570323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:32.790632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1316c2b848934f7ca8204128d68fca9f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:32.808597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1316c2b848934f7ca8204128d68fca9f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:33.054388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1316c2b848934f7ca8204128d68fca9f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:33.067426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1316c2b848934f7ca8204128d68fca9f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:33.067840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1316c2b848934f7ca8204128d68fca9f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:33.074247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 746/1507] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:05:32 2022] DELETE /identity/v3/users/1316c2b848934f7ca8204128d68fca9f => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:05:33.078804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:33.079098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:33.079382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:33.135843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:05:33.137044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:33.213200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:33.225157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 762/1508] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:05:33.236248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:33.237510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:33.338695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212bf66-6270-45e8-ae1b-f605b5d040d2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:33.393090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:33.411802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:33.412672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:33.412962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:33.413236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:33.414882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:33.525254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:33.526703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a50a6-fd67-4c21-9db2-a607696a8579 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:33.545489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 747/1509] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:05:33.969727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:05:33.970983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:05:33.982683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbf042-79b7-4d23-9070-61943e7eb16c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:05:34.084843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:05:34.085975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:05:34.086257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:05:34.086531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] PATH_INFO: `/v3/projects/9eb01fd3abdd4ad7ad14819aa60adcdf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:05:34.096618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb01fd3abdd4ad7ad14819aa60adcdf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:05:34.097633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:05:34.097633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:05:34.097633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:05:34.098821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:05:34.219039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb01fd3abdd4ad7ad14819aa60adcdf', 'request_id': 'req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:34.225399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb01fd3abdd4ad7ad14819aa60adcdf', 'request_id': 'req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:34.305212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb01fd3abdd4ad7ad14819aa60adcdf', 'request_id': 'req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:34.335751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] The token cache is being invalidate because project 9eb01fd3abdd4ad7ad14819aa60adcdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:05:34.336041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:34.336563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cbe593bf-bf40-4eaa-b5fe-c27929e5e2c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:05:34.337924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 763/1510] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:05:33 2022] DELETE /identity/v3/projects/9eb01fd3abdd4ad7ad14819aa60adcdf => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:05:43.543192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=62 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:05:44.334107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:19.606273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:19.606868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:19.606868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:19.608236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:19.613137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d97c-50ae-427b-9980-2812caa1aa90 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:19.613759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d97c-50ae-427b-9980-2812caa1aa90 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:19.613915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d97c-50ae-427b-9980-2812caa1aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:19.692080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2774d97c-50ae-427b-9980-2812caa1aa90 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:19.693281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2774d97c-50ae-427b-9980-2812caa1aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:19.796454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:07:19.952958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:19.955097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:20.077449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43033a67-ea72-4345-8e02-0dcd131a2c1b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:20.083137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:20.083831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:20.084119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:20.084400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:20.093223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:20.094798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ef2f-3e58-4b5a-b749-6a23f1636239 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:20.104788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 749/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:20.930856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868ad9e-2274-4609-9527-90ea0556c22c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:20.931441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868ad9e-2274-4609-9527-90ea0556c22c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:20.931574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868ad9e-2274-4609-9527-90ea0556c22c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:20.932915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:20.937946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4818a-749a-4e61-aa61-f54bad110bcd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:20.938349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4818a-749a-4e61-aa61-f54bad110bcd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:20.938506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4818a-749a-4e61-aa61-f54bad110bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:20.957575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-19c4818a-749a-4e61-aa61-f54bad110bcd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:20.958805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-19c4818a-749a-4e61-aa61-f54bad110bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:20.966956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:21.120311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868ad9e-2274-4609-9527-90ea0556c22c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:21.134998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868ad9e-2274-4609-9527-90ea0556c22c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:21.140709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:21.141358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:21.141648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:21.141928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:21.151085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:21.152690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cc33f-05d9-4ce5-8b1d-dbb6a28bb470 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:21.162065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 766/1516] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:21.578812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461f52-32d1-44cf-bd7e-9390ea390531 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:21.579108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461f52-32d1-44cf-bd7e-9390ea390531 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:21.579421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1461f52-32d1-44cf-bd7e-9390ea390531 None None] PATH_INFO: `/v3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:21.580773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 751/1517] 10.222.0.18 () {54 vars in 925 bytes} [Mon Jul 25 06:07:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:07:21.587383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103dbb-054d-4312-a73b-b9dfb4f48c18 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:21.587737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103dbb-054d-4312-a73b-b9dfb4f48c18 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:21.588024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103dbb-054d-4312-a73b-b9dfb4f48c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:21.644554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15103dbb-054d-4312-a73b-b9dfb4f48c18 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:21.645740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15103dbb-054d-4312-a73b-b9dfb4f48c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:21.662414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:21.715921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 767/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 06:07:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:30.853675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02582df-6ca1-4a53-9589-4d5fd75109e9 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:30.854226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02582df-6ca1-4a53-9589-4d5fd75109e9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:30.854226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02582df-6ca1-4a53-9589-4d5fd75109e9 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:30.855508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 752/1519] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jul 25 06:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:30.860333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3823-0535-448e-a7e3-5a327bf7d0e8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:30.860744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3823-0535-448e-a7e3-5a327bf7d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:30.860897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c3823-0535-448e-a7e3-5a327bf7d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:30.879068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b97c3823-0535-448e-a7e3-5a327bf7d0e8 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:30.880314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b97c3823-0535-448e-a7e3-5a327bf7d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:30.889915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 768/1520] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jul 25 06:07:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:30.898479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02582df-6ca1-4a53-9589-4d5fd75109e9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:30.911896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02582df-6ca1-4a53-9589-4d5fd75109e9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:30.917053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:30.917900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:30.918025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:30.918230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:30.926754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:30.928434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e5e850-0ddd-476a-9370-917f42829ff3 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:30.938089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 753/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:32.401396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de62d7-5e63-4356-9df5-454fb5c3836f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:32.401948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de62d7-5e63-4356-9df5-454fb5c3836f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:32.401948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de62d7-5e63-4356-9df5-454fb5c3836f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:32.403258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:32.408100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae492-3745-4301-b276-4db3e21b8a98 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:32.408498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae492-3745-4301-b276-4db3e21b8a98 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:32.408670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fae492-3745-4301-b276-4db3e21b8a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:32.426740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-68fae492-3745-4301-b276-4db3e21b8a98 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:32.427988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-68fae492-3745-4301-b276-4db3e21b8a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:32.436495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:32.590013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de62d7-5e63-4356-9df5-454fb5c3836f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:32.603987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de62d7-5e63-4356-9df5-454fb5c3836f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:32.609497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:32.610124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:32.610407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:32.610681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:32.619462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:32.621190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4b173-4efb-4ae6-bab4-6c26dbed0c7d service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:32.630453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 770/1524] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:33.445787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282443-2bf0-43c1-9412-564dac41c062 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:33.446333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282443-2bf0-43c1-9412-564dac41c062 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:33.446333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7282443-2bf0-43c1-9412-564dac41c062 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:33.447674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 06:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:33.452462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bac0-f387-4b03-9b9b-0ce8ddb6bdb3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:33.452883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bac0-f387-4b03-9b9b-0ce8ddb6bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:33.453026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674bac0-f387-4b03-9b9b-0ce8ddb6bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:33.471236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9674bac0-f387-4b03-9b9b-0ce8ddb6bdb3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:33.472462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9674bac0-f387-4b03-9b9b-0ce8ddb6bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:33.480911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 06:07:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:33.635033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7282443-2bf0-43c1-9412-564dac41c062 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:33.649574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7282443-2bf0-43c1-9412-564dac41c062 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:33.655032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:33.655741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:33.656030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:33.656311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:33.664457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:33.666048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4acd21c-2b99-40da-b893-fda954b8b39e service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:33.675432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 756/1527] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:38.024207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:38.024774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:38.024774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:38.026173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:38.031417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad903ae-22b7-42a3-a907-14005c051be9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:38.031908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad903ae-22b7-42a3-a907-14005c051be9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:38.032009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad903ae-22b7-42a3-a907-14005c051be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:38.050748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4ad903ae-22b7-42a3-a907-14005c051be9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:38.051978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4ad903ae-22b7-42a3-a907-14005c051be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:38.059770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:38.133779 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:38.135540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:38.212902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a6eaf-4832-4a00-8ae8-212d0d2d44c6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:38.216475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:38.217121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:38.217407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:38.217688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:38.227166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:38.228626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90af0c-12d9-4b30-99af-792b9530c020 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:38.238370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 773/1530] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:40.262924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2115-9c05-4ff5-a49b-03694fb6e5c3 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:40.263403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2115-9c05-4ff5-a49b-03694fb6e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:40.263513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d2115-9c05-4ff5-a49b-03694fb6e5c3 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:40.264878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:40.270235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d799-60f7-4f91-bd9e-88e0c76d8403 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:40.270665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d799-60f7-4f91-bd9e-88e0c76d8403 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:40.270792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d799-60f7-4f91-bd9e-88e0c76d8403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:40.290310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-00c5d799-60f7-4f91-bd9e-88e0c76d8403 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:40.291490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-00c5d799-60f7-4f91-bd9e-88e0c76d8403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:40.299263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:40.336259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2115-9c05-4ff5-a49b-03694fb6e5c3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:40.346729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d2115-9c05-4ff5-a49b-03694fb6e5c3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:40.350208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:40.350840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:40.351124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:40.351402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:40.360194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:40.361613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0eebf-4943-4f3c-be4a-5a6e57626fdd service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:40.371482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 759/1533] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:44.087614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:44.088137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:44.088249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:44.089698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:44.095585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017943ea-f256-4427-b7ca-1f913b0b75b6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:44.096005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017943ea-f256-4427-b7ca-1f913b0b75b6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:44.096271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017943ea-f256-4427-b7ca-1f913b0b75b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:44.103440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:44.115792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-017943ea-f256-4427-b7ca-1f913b0b75b6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:44.123238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-017943ea-f256-4427-b7ca-1f913b0b75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:44.124926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:44.430394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:44.432097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:44.496563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:44.509586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90524729-641d-4ecd-bfa4-6757a70a4ad5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:44.513232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:44.513871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:44.514154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:44.514428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:44.523991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:44.525406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693224c-89e1-4fc3-8d4e-92a274fefba6 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:44.535362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 776/1536] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:46.576391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:46.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:46.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:46.578342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 06:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:07:46.583359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5cbcd-05ae-407d-a473-634f7f8ee216 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:46.583783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5cbcd-05ae-407d-a473-634f7f8ee216 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:46.583960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5cbcd-05ae-407d-a473-634f7f8ee216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:46.602270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c9a5cbcd-05ae-407d-a473-634f7f8ee216 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:07:46.603448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c9a5cbcd-05ae-407d-a473-634f7f8ee216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:46.611577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 06:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:07:46.916734 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:07:46.918431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:07:46.931585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40f9c2-417d-409d-8e89-5919dbc65f2c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:07:46.935250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:07:46.935935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:07:46.936220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:07:46.936499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:07:46.946040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:07:46.954297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d551f21-5c56-43f0-a059-0db9132265c3 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:07:46.956845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 762/1539] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:07:56.597720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=11 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:07:56.952737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=8 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:23.488186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.489296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.489875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.513256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:23.514894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:23.527818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 778/1540] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:23.537663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.537663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.537663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.566464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:23.567866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:23.582747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 763/1541] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:23.588237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:23.601462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaec37c9-7b67-45d6-b24d-dfcdc9d9ad10 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:23.607933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:23.608869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.609372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.609858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.610794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:23.611335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:23.617243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:23.631893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 779/1542] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:23.640312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:23.651194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8aee9-3efb-4fca-ae0d-e4bc624474ea None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:23.665702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:23.666785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.667078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.667355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.668107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:23.670248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24c456-9b86-4de7-b82b-601a7a97092a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:23.809322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 764/1543] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:23 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:23.813725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:23.817660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21f7d-d14a-483a-bfe0-fd9b791ecab0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.818800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21f7d-d14a-483a-bfe0-fd9b791ecab0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.819105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a21f7d-d14a-483a-bfe0-fd9b791ecab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.829343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f5735-7edc-4a39-be92-74d946a0c450 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:23.848654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-85a21f7d-d14a-483a-bfe0-fd9b791ecab0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:23.850606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-85a21f7d-d14a-483a-bfe0-fd9b791ecab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:23.940362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:23.941498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:23.942308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:23.943398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:23.944744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:23.947433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:23.994660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 765/1544] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.003299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.003650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.003898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.051681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.053377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.058331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 780/1545] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:23 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:24.068583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.085128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 766/1546] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:09:24.089911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.093560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ae945-cd82-41aa-89da-e0942f23a0b1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.105582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.106570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d522e4-e05b-41b5-bff0-5fa82b2c1951 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.106994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.107500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.108614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.109604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.113895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.132613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.133374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.133889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.134178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.135094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:24.135421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.136504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:24.136504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:09:24.136504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:09:24.146148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.146248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 781/1547] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:24.146828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.167516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf394a-0a4d-45d3-aa21-a9adc3f61325 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.168033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 767/1548] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:24.176695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.188811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.189834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.192413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.193817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.194801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.199141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724535a3-ee2e-46a9-b5d7-5a8a91dcfe88 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.200635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763a31a-e6b3-4426-a210-e9e29b51e91d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.229402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.230679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.230679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.230679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.231320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.233448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace015e-f4c5-4928-8335-a5f97ceab7ab admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.241086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 782/1549] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:24.244062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.248036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.249165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.315869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.317455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.345332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 783/1550] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.345332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.357700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22f40d-ba2e-414b-89dc-f0396ab0a4ac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.371191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.372221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.372502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.372778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] PATH_INFO: `/v3/projects/372c637d60e74f9193d008d180447392/users/f5464624509844deaac583112045530c/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.384815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 768/1551] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:24.386313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37960b-9193-447d-91fd-bb172e8fbb0f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.386607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37960b-9193-447d-91fd-bb172e8fbb0f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.386970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37960b-9193-447d-91fd-bb172e8fbb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.407814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372c637d60e74f9193d008d180447392, user_id=f5464624509844deaac583112045530c, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.408921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:24.408921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:09:24.408921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:09:24.410915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.428899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bf37960b-9193-447d-91fd-bb172e8fbb0f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.431601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bf37960b-9193-447d-91fd-bb172e8fbb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.505965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 784/1552] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:24 2022] PUT /identity/v3/projects/372c637d60e74f9193d008d180447392/users/f5464624509844deaac583112045530c/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:24.508028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.517917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 769/1553] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.519246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a82de-5d2d-484b-8aed-9d4388d9f959 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.519542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a82de-5d2d-484b-8aed-9d4388d9f959 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.519850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a82de-5d2d-484b-8aed-9d4388d9f959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.539818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3f4a82de-5d2d-484b-8aed-9d4388d9f959 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.541026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3f4a82de-5d2d-484b-8aed-9d4388d9f959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.561202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:24.605121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881ccd4-68fd-47cc-a984-0a83d3262a81 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.613785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.614455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.616225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.616225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.616401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.620492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 770/1554] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.620671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd45d5a-7b91-4a6c-af0e-53b07083f5d1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.620848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029961-d396-429e-ba8f-f11eb2a8377a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.620848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029961-d396-429e-ba8f-f11eb2a8377a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.620848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e029961-d396-429e-ba8f-f11eb2a8377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.638545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9e029961-d396-429e-ba8f-f11eb2a8377a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.640046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9e029961-d396-429e-ba8f-f11eb2a8377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.648785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 771/1555] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.649984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb7d5-cb62-4b99-a251-c79a3b4089a1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.650275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb7d5-cb62-4b99-a251-c79a3b4089a1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.650557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10bb7d5-cb62-4b99-a251-c79a3b4089a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.669354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f10bb7d5-cb62-4b99-a251-c79a3b4089a1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.670551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f10bb7d5-cb62-4b99-a251-c79a3b4089a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.678870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 772/1556] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.680145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164f16-2ae6-4652-9342-b063af943909 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.680439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164f16-2ae6-4652-9342-b063af943909 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.680726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35164f16-2ae6-4652-9342-b063af943909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.698333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-35164f16-2ae6-4652-9342-b063af943909 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.699516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-35164f16-2ae6-4652-9342-b063af943909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.707086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 773/1557] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.708058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164f16-2ae6-4652-9342-b063af943909 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.719288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35164f16-2ae6-4652-9342-b063af943909 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.723725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 785/1558] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:24.723725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdb3-4abb-49bb-8a09-968671005567 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.723725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdb3-4abb-49bb-8a09-968671005567 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.723725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2fdb3-4abb-49bb-8a09-968671005567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.729124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.729124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.729124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.729124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.729496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:24.729496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.729496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47975d20-98e9-4d4b-8765-779bbd273999 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.736714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:24.740915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 774/1559] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:24.748227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19adb-2099-44cb-8e5b-10e7dcf4c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.748227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19adb-2099-44cb-8e5b-10e7dcf4c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.748227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e19adb-2099-44cb-8e5b-10e7dcf4c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.749237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b7f2fdb3-4abb-49bb-8a09-968671005567 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.750469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b7f2fdb3-4abb-49bb-8a09-968671005567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.759225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 786/1560] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.760556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5d50-4c6b-4398-ad6d-64459bc92152 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.760852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5d50-4c6b-4398-ad6d-64459bc92152 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.761133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a5d50-4c6b-4398-ad6d-64459bc92152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.761404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d3e19adb-2099-44cb-8e5b-10e7dcf4c2f6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.762579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d3e19adb-2099-44cb-8e5b-10e7dcf4c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.772743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 775/1561] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.773980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.774267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.774548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.780897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-913a5d50-4c6b-4398-ad6d-64459bc92152 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.782093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-913a5d50-4c6b-4398-ad6d-64459bc92152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.790345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 787/1562] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.791698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.791994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.792278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.800389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.801622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.810305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 776/1563] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.810499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.811517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.811680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.821688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 788/1564] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.822424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.831928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1aba2c-eb07-4063-b5dc-b46b7c0d4607 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.837393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.838043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.838327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.838585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.839597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.840931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.854463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 789/1565] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:24.854463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.862145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8dd0-52a9-41a7-87dc-7eb64956b9c7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.866810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a757f-744b-41dc-b537-8ba619e0b45e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.866967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.867614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.867907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.868194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.868872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.869867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:24.869867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:09:24.869867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:09:24.870778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:24.871098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.871422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.871743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.872023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.881801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:24.883231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd9b5c-6717-4ca9-957a-ede40bc85d83 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:24.892968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 777/1566] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:24.895733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e54e3-993e-441e-a744-4b01aabdfc5c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.895733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e54e3-993e-441e-a744-4b01aabdfc5c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.895733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e54e3-993e-441e-a744-4b01aabdfc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.913957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-634e54e3-993e-441e-a744-4b01aabdfc5c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.915276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-634e54e3-993e-441e-a744-4b01aabdfc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.923251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 778/1567] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.924525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:24.924809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:24.925085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:24.943210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:24.944473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:24.952417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 779/1568] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:24.953200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:24.962852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 790/1569] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:24.966400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd317071-b76e-469f-9e68-d4be792655a7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:24.966529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.030151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.031028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.031758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.032109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.033622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:25.033954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.035154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7d30-2939-4abc-8f5a-09f30eed3f2d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.035900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.043529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.043529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.043529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.043529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.044039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:25.044039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.046283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.054365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:25.060618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 780/1570] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:25.060618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.060848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 791/1571] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:25.061558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.075781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e873543-ccfd-4e27-af8b-845aea84a479 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.080507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.081183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.081469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.081750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.082477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:25.082807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.084819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d601d88-b21b-4d23-bb89-1d198175df2f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.086985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.089997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.090670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.090958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.091238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.092001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.093588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.097805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 781/1572] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:25.098559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.109642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd13ed-bcf0-4ed4-a2b9-152c09b50831 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.111058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 792/1573] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:25.112040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.122522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.122522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.122522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.122522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.123090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:25.123090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.123090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.123295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceadf8-3ff9-489a-9995-48bb22fccc64 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.127536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.128209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.128495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.128781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.129494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:25.129800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.130600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 782/1574] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:25.131510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.136508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.143298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b631ea6-4420-4824-92e5-1638207f81af admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.149154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.149940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.150357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.150738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.151138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 793/1575] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:25.151655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.151882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.152967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:25.152967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:09:25.152967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:09:25.154418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.164124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb6123-ad5c-4eef-afa8-9c4699ba52a8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.169146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.169805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.170091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.170371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.171064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.173000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.246525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 783/1576] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.247731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.258065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b237d-6799-4b23-bf7d-08d0e2ed34b2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.262710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.263365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.263684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.263968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.264919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.266875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.279593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 794/1577] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/projects => generated 393 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.279593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.340485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244ff8e-8f75-49e6-9699-0df0de59c1fd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.345119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.345782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.346077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.346345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.347029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.349020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.353051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:25.385350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 784/1578] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.386432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.452169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bf952-aa05-4f0f-a2ec-21c36b7367aa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.464711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.466031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.466548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.466969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] PATH_INFO: `/v3/projects/f33b1938a5b946c6af0fda92bdc6b714/users/368ce69362a248da810f646c395c4dfa/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.467962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 795/1579] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.469075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.492490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33b1938a5b946c6af0fda92bdc6b714, user_id=368ce69362a248da810f646c395c4dfa, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.495397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.544628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c696b-bf4c-4d39-8a8e-c142785aec24 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.549227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.549885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.550171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.550449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.551130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.554342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.588711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 785/1580] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:25 2022] PUT /identity/v3/projects/f33b1938a5b946c6af0fda92bdc6b714/users/368ce69362a248da810f646c395c4dfa/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:25.589521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.653818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 796/1581] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/projects => generated 367 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.654755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.663494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a212cc-6a22-484a-9ecd-59cbd2821a72 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.686437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:25.726330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.727012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.727300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.727598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.727869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb1df-d27a-473e-9298-09c8d5dc0d87 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.728292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.730346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.733435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.734108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.734395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.734672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.735439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.737081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.747683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 797/1582] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:25.748505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.758634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5ce69-1c06-45d1-ab8e-be1c12a944fb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.763399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.764334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.764879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.765160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.765846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.767833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.819007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 786/1583] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.820132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.878994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 798/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.878994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:25.888667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b257-872c-41f5-a09d-462633116029 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.893611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945ff42-f0d0-4403-a990-8a817ddf0f09 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:25.894078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.894892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.895175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.895701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.896664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.898983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc7c4c-fcfd-415e-b549-252dbf0c9fce admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.899112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:25.900098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.900385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.905298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:25.905298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:25.905298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:25.998144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 799/1585] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:25.998144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:25.998144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:25.998144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.003289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 787/1586] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:26.003289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.014248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9f419-accb-42bc-bfc3-8477c6773d88 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.019675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.020334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.020618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.020921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.021617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.023526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.025709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] MFA Rules not processed for user `368ce69362a248da810f646c395c4dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:26.026912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:26.048356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:26.092988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 800/1587] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:26.093964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.105038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 788/1588] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:26 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:26.106296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.106428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f6fd8-c039-44b0-afd4-05eaf317fec2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.111108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.111982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.112272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.112684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.113418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.115611 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.117074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f68953-0751-456f-b270-b7bdc0a24e62 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.121706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.122366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.122661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.122943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.123724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.125644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.134719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 801/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.134719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.144285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6eb67-849b-4e20-8bd1-046c94143147 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.149348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.150104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.150469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.150823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.151661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.153299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.164500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 802/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.165249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.175485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3d575-98d7-4ea2-a73c-cfdadfd5cd41 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.181417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.182093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.182365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.182639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.183379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.185024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.196215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 803/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.196974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.206623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e0623-199e-474c-afc9-3e8df10200b8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.212253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.212944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.213232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.213509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.214234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.215856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.226649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 804/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.227460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.242050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eafad1-efbe-43a5-9faf-a70cd0d5d441 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.251074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 789/1593] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:26 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:26.251074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.251329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.251329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.251329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.251329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.252715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.262896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.265089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca9489-33fd-4a1e-9479-228eb43c6377 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.270168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.271090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.271905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.271905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.272774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.274657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.293069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 790/1594] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.293222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.304638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cdddda-a6fb-447e-a6ae-8f26fd109dfe admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.310639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.311539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.311865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.312151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] PATH_INFO: `/v3/projects/7a27d89b661143b48b22f393617cc3b1/users/cb480fa8195647cfa6bcf3c5383b9229/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.330756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a27d89b661143b48b22f393617cc3b1, user_id=cb480fa8195647cfa6bcf3c5383b9229, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.334506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.346418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 805/1595] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:26 2022] POST /identity/v3/projects => generated 365 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:26.347416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.418288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b77a6d-e759-4168-9118-9a84d3132a18 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.423345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.424167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.424494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.424909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.425698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.428330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.443964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 791/1596] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:26 2022] PUT /identity/v3/projects/7a27d89b661143b48b22f393617cc3b1/users/cb480fa8195647cfa6bcf3c5383b9229/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:26.443964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.447642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 806/1597] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.448318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.460213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f7ce5-da2d-45c7-8b25-a70a1dffc924 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.479809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:26.515207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3877-cf37-46b9-a561-7eb7135afde8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.515430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:26.520074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.521308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.521632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.522090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.523068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.524862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.525993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.526910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.527354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.527876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.528776 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.530549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.541317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 792/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.542299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.546133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 807/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.546133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.554311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12f98-1b4f-4264-bf45-a9b28bd8a66a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.556156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4859-4ae5-40c8-a1e5-57775561555b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.559636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310801e-1719-4338-acfb-81484030964a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.560611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310801e-1719-4338-acfb-81484030964a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.561070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310801e-1719-4338-acfb-81484030964a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.561317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.561742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310801e-1719-4338-acfb-81484030964a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.562118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.562471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.562814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.563228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310801e-1719-4338-acfb-81484030964a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.563807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.565355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310801e-1719-4338-acfb-81484030964a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.565933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce991f-0cbd-4038-99e7-5bf03bd5e2df admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.580131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 793/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.581102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310801e-1719-4338-acfb-81484030964a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.584522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 808/1601] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:26.586335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.586627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.586990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.600347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310801e-1719-4338-acfb-81484030964a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.605595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.606567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.607202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.607202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.607868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.609563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:26.609804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.611004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:26.620672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 809/1602] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:26.626573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.632678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a75cb9-f63d-4222-863f-66a8892ba9c5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.637333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.638347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.638715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.639057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] PATH_INFO: `/v3/projects/504cd6ee394b4fde991cee6e35cfddc1/users/10875af9fd904150ac8baac0a4c83a73/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.656387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] RBAC: Authorizing `identity:create_grant(project_id=504cd6ee394b4fde991cee6e35cfddc1, user_id=10875af9fd904150ac8baac0a4c83a73, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.659359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.736830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 794/1603] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:26 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:26.737480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.757403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6149c-34fb-465d-b77f-bb5da4128835 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.760478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 810/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:26 2022] PUT /identity/v3/projects/504cd6ee394b4fde991cee6e35cfddc1/users/10875af9fd904150ac8baac0a4c83a73/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:26.761379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:26.845468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.846421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.846712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.846998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] PATH_INFO: `/v3/projects/3cb92a533e7148d8ab3679644bd353e9/users/c669b834d35c4822ac0602155b3007bc/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.848385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c028f5-3010-45e4-a338-fccbba00100c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:26.854991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:26.856328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:26.856799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:26.857280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] PATH_INFO: `/v3/projects/28125bc085d54714a5214be89b5fc2ec/users/07745a554ef64cfe878a418fd4e34503/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:26.865850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb92a533e7148d8ab3679644bd353e9, user_id=c669b834d35c4822ac0602155b3007bc, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.869108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.876647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28125bc085d54714a5214be89b5fc2ec, user_id=07745a554ef64cfe878a418fd4e34503, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:26.879577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:26.966929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 795/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:26 2022] PUT /identity/v3/projects/3cb92a533e7148d8ab3679644bd353e9/users/c669b834d35c4822ac0602155b3007bc/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:26.967782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.001340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 811/1606] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:26 2022] PUT /identity/v3/projects/28125bc085d54714a5214be89b5fc2ec/users/07745a554ef64cfe878a418fd4e34503/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:27.002481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.059003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acc2f9-daf6-47f7-be24-a65c647bd939 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.086473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e7ed3-8553-4c55-9ae8-491bf8072ae9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.091757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.092811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.093161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.093505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] PATH_INFO: `/v3/projects/e07ecf0ed022414287428c05ef795920/users/8e265bde3a5c47efbb58bc5feac48e4f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.109250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:27.123138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07ecf0ed022414287428c05ef795920, user_id=8e265bde3a5c47efbb58bc5feac48e4f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.129744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.157709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.158515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.159001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.159358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.160224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.162709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.173425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 796/1607] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:27.174379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.231498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 812/1608] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:27 2022] PUT /identity/v3/projects/e07ecf0ed022414287428c05ef795920/users/8e265bde3a5c47efbb58bc5feac48e4f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:27.231721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.247041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:27.250000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49535de2-88d8-4903-9cbb-c8a81bd9576c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.312958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e217b8c-0c62-4dbe-af2b-e0cca6f523a3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.316612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.317421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.317703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.317829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.318004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.318574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.318865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.319148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.320028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.321622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587ee80-2553-4fc2-bf07-6a7e1c79cc8e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6367a7-0054-4fc5-978f-c01d85e0957d service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 797/1609] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb29d2-359c-4d53-89ba-11b934783915 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb29d2-359c-4d53-89ba-11b934783915 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.429457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb29d2-359c-4d53-89ba-11b934783915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.430892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 813/1610] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:27.430892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.430892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.430892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.431883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41cb29d2-359c-4d53-89ba-11b934783915 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:27.431883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41cb29d2-359c-4d53-89ba-11b934783915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:27.431883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 798/1611] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:27.431883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.432600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:27.432808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.432808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.432998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:27.437005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 814/1612] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:27.437758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.458860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16339b-a8ff-45d1-a990-394ae6f8f021 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.464769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.465633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.465932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.466486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] PATH_INFO: `/v3/projects/b156d96af60346eb82fb32eb73350e28/users/bef94a2d83844179aa3976a0a133a727/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.468717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] MFA Rules not processed for user `07745a554ef64cfe878a418fd4e34503`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:27.470036 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:27.497033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b156d96af60346eb82fb32eb73350e28, user_id=bef94a2d83844179aa3976a0a133a727, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.500778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387e9b0-8c33-4c2d-a1f0-21701194d30f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.566464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 815/1613] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:27 2022] PUT /identity/v3/projects/b156d96af60346eb82fb32eb73350e28/users/bef94a2d83844179aa3976a0a133a727/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:27.570860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.570860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.570860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.575605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 799/1614] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:27.576731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.586001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:27.592118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f450b-9845-4fe5-a3fc-108565b54ddf None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.612824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] MFA Rules not processed for user `8e265bde3a5c47efbb58bc5feac48e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:27.614232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:27.656585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.657505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.657792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.658070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] PATH_INFO: `/v3/projects/071eec02b23242a2be9dd63d2651b85e/users/460d4f3b21144a5db251504b846a2bc6/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.684650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=071eec02b23242a2be9dd63d2651b85e, user_id=460d4f3b21144a5db251504b846a2bc6, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.693273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.693460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 816/1615] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:27.693460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.760443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 800/1616] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:27 2022] PUT /identity/v3/projects/071eec02b23242a2be9dd63d2651b85e/users/460d4f3b21144a5db251504b846a2bc6/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:27.762546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.778151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bffac-5b1e-43c5-b083-48fcba921cb3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.804605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:27.838955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca851486-6038-4689-99c9-8609b2b8c6fa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:27.840645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.841404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.841695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.841993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.843314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:27.844441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.844800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.845167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.921583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.923946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25397fd-6204-4770-b4aa-4606aaa4166f service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.937209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 817/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:27.939507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:27.940044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:27.940664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:27.950157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:27.952032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:27.968343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 801/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:27.969273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:27.993762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] MFA Rules not processed for user `bef94a2d83844179aa3976a0a133a727`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:28.000269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:28.069069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:28.107009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d02b8-5e85-4c8b-ab74-ff1a6e319db2 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.113509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.114196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.115218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.115672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.141213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 818/1619] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:28.142457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.154210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f81907-5766-40a7-910a-335cd1b704c9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.160681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.164251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.164251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.164251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.251628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.253132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.265896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 819/1620] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:28.266858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.275107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:28.282444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a1322-28d5-4eb3-af63-92845952f3bf service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.285089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.289073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.289880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.290053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.290450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.290932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.291997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.294814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.305171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 802/1621] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:28.306254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.341895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 820/1622] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:28.342430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2662807-ee18-4d9b-8cd5-dad285894d89 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.343649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.359150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.359863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.362481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.362771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.363489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.369922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.372275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f445638-ef41-4da3-a7ec-06b58b4a8f8b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.392091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.394515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.396453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.396753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] PATH_INFO: `/v3/projects/071eec02b23242a2be9dd63d2651b85e/users/460d4f3b21144a5db251504b846a2bc6/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.408314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] RBAC: Authorizing `identity:create_grant(project_id=071eec02b23242a2be9dd63d2651b85e, user_id=460d4f3b21144a5db251504b846a2bc6, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.408314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df79c121-bcdc-433b-b557-30367002affa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.438165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 821/1623] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:28 2022] PUT /identity/v3/projects/071eec02b23242a2be9dd63d2651b85e/users/460d4f3b21144a5db251504b846a2bc6/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:28.448808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.449072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.449458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.515236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] MFA Rules not processed for user `460d4f3b21144a5db251504b846a2bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:28.516574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:28.542676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 803/1624] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:28 2022] POST /identity/v3/projects => generated 381 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:28.547255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.697520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 822/1625] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:28.698092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6251387-3728-4988-852b-dc021d2e349d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.712355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.713383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.713680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.713961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.716075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.721984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.829223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 804/1626] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:28 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:28.829875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:28.952388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300edff-9af7-4f46-a39b-18e8b2313207 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:28.960482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:28.964008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:28.964008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:28.964008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:28.964766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:28.968584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:28.999528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 823/1627] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:29.003603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:29.023085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb13884-86a9-4874-bca2-0f8546843071 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:29.037952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:29.038508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:29.038966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:29.039259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] PATH_INFO: `/v3/projects/477752b81bf14190b97292658f184a5d/users/922e14ab4c0b4386a3d9601bf9a6d856/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:29.062387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] RBAC: Authorizing `identity:create_grant(project_id=477752b81bf14190b97292658f184a5d, user_id=922e14ab4c0b4386a3d9601bf9a6d856, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:29.065122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:29.196461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 805/1628] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:29 2022] PUT /identity/v3/projects/477752b81bf14190b97292658f184a5d/users/922e14ab4c0b4386a3d9601bf9a6d856/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:29.197339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:29.224050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf0419-7f35-4fba-bd73-8a199250d814 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:29.361993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:29.362858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:29.363218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:29.364060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:29.365015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:29.368081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c082df-b690-4ecd-8817-6983b0af8c33 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:29.375331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:29.383144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 824/1629] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:09:29.387133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:29.410343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d37cb-8fb8-4c3a-902c-76e1a052162b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:29.420592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:29.425915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:29.426318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:29.427327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] PATH_INFO: `/v3/projects/477752b81bf14190b97292658f184a5d/users/922e14ab4c0b4386a3d9601bf9a6d856/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:29.430090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=477752b81bf14190b97292658f184a5d, user_id=922e14ab4c0b4386a3d9601bf9a6d856, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:29.436366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:29.480174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 806/1630] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:29 2022] PUT /identity/v3/projects/477752b81bf14190b97292658f184a5d/users/922e14ab4c0b4386a3d9601bf9a6d856/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:29.484254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:29.484620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:29.484927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:29.542952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:29.546881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] MFA Rules not processed for user `922e14ab4c0b4386a3d9601bf9a6d856`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:29.548854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:29.614045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:29.703927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd8b1d-b647-441d-b42d-29e32af9de9a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:29.719615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:29.719615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:29.719615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:29.719615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:29.731999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 825/1631] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:29.864980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:29.866657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:30.236975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 807/1632] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:09:30.239661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:30.239661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81adc2-d190-4abd-a684-bdbe411fafec None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:30.239661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:30.239661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:30.241271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:30.241271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:30.241271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:30.241271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:30.241271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 826/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:30.437216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:30.448917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bbe3-0897-4150-9558-714a2829d8f7 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:30.453045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:30.457131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:30.461249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:30.462282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:30.463936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5726896c-eff4-42a4-bc93-336938daa3de service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:30.464349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:30.476760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:30.476760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:30.476760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:30.476760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:30.592823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:30.598990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1c9dd-41f5-4391-8177-2b095d6df036 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:30.603925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:30.605970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87265e43-079d-4996-aff2-755711f81d0f service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:30.616743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 827/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:09:30.622206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 808/1635] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:33.157659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d412e-a7a7-490f-a1a0-8500ac0a7939 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:33.159063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d412e-a7a7-490f-a1a0-8500ac0a7939 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:33.159063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d412e-a7a7-490f-a1a0-8500ac0a7939 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:33.161594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 828/1636] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jul 25 06:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:33.182425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1119e-2708-4480-b9d8-4f1e4f1d2e59 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:33.183404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1119e-2708-4480-b9d8-4f1e4f1d2e59 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:33.183847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1119e-2708-4480-b9d8-4f1e4f1d2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:33.294786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6ae1119e-2708-4480-b9d8-4f1e4f1d2e59 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:33.296422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6ae1119e-2708-4480-b9d8-4f1e4f1d2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:33.374871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:33.413691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 809/1637] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jul 25 06:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:33.421156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0197-84ad-4a57-8e2f-36ff4c7918cb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:33.421986 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0197-84ad-4a57-8e2f-36ff4c7918cb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:33.422437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f0197-84ad-4a57-8e2f-36ff4c7918cb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:33.424327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 829/1638] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jul 25 06:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:33.431146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5cce-85ac-4c2e-b6e4-ecdff7a4a0bc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:33.431450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5cce-85ac-4c2e-b6e4-ecdff7a4a0bc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:33.431981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce5cce-85ac-4c2e-b6e4-ecdff7a4a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:33.464123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-09ce5cce-85ac-4c2e-b6e4-ecdff7a4a0bc None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:33.467049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-09ce5cce-85ac-4c2e-b6e4-ecdff7a4a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:33.479404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 810/1639] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:33.778748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f0197-84ad-4a57-8e2f-36ff4c7918cb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:33.813843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f0197-84ad-4a57-8e2f-36ff4c7918cb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:33.841185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:33.843398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:33.847719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:33.848359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:33.886818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:33.889562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff7d8-e6f1-4203-9673-a3bcc465a971 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:33.937504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 830/1640] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:34.606094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989a7e-9f49-4282-9f55-116ab4e39668 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:34.606094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989a7e-9f49-4282-9f55-116ab4e39668 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:34.606094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed989a7e-9f49-4282-9f55-116ab4e39668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:34.691468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ed989a7e-9f49-4282-9f55-116ab4e39668 None None] MFA Rules not processed for user `f5464624509844deaac583112045530c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:34.694006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ed989a7e-9f49-4282-9f55-116ab4e39668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:34.824712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 811/1641] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:34.861740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d55e0-5ba1-418b-a8d1-041de42aa8da None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:34.862289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d55e0-5ba1-418b-a8d1-041de42aa8da None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:34.862289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d55e0-5ba1-418b-a8d1-041de42aa8da None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:34.864120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 831/1642] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jul 25 06:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:34.878305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8f8d-867a-4ee9-985d-239e0f4772b8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:34.878564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8f8d-867a-4ee9-985d-239e0f4772b8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:34.878853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b8f8d-867a-4ee9-985d-239e0f4772b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:34.940618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b64b8f8d-867a-4ee9-985d-239e0f4772b8 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:34.944743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b64b8f8d-867a-4ee9-985d-239e0f4772b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:34.953056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 812/1643] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jul 25 06:09:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:34.962252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d55e0-5ba1-418b-a8d1-041de42aa8da None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:34.987278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d55e0-5ba1-418b-a8d1-041de42aa8da None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:35.001883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:35.005737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:35.005737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:35.006007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:35.033053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:35.040136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:35.064635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 832/1644] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:38.682183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225e66-ccc5-4919-857c-3e92269a14d2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:38.682644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225e66-ccc5-4919-857c-3e92269a14d2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:38.682717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08225e66-ccc5-4919-857c-3e92269a14d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:38.777114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-08225e66-ccc5-4919-857c-3e92269a14d2 None None] MFA Rules not processed for user `cb480fa8195647cfa6bcf3c5383b9229`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:38.779021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-08225e66-ccc5-4919-857c-3e92269a14d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:38.909428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 813/1645] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:38.925690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:38.948077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56f859-81e2-4135-8540-a3c86a932d1b service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:38.970822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:38.971983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:38.972469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:38.974270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:38.991592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:38.993862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd4801-fe99-48c9-8b28-cd8d65e1a594 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:39.010142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 833/1646] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:39.645173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa786f0-d7cb-49b0-929c-9ebac4a78377 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:39.646829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa786f0-d7cb-49b0-929c-9ebac4a78377 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:39.646829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa786f0-d7cb-49b0-929c-9ebac4a78377 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:39.647681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 814/1647] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jul 25 06:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:39.667033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9c16-dc0f-4cd8-bea9-e3257caad876 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:39.667335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9c16-dc0f-4cd8-bea9-e3257caad876 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:39.667647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c9c16-dc0f-4cd8-bea9-e3257caad876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:39.723304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-380c9c16-dc0f-4cd8-bea9-e3257caad876 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:39.733723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-380c9c16-dc0f-4cd8-bea9-e3257caad876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:39.766018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 834/1648] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:09:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:39.812600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa786f0-d7cb-49b0-929c-9ebac4a78377 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:39.827940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa786f0-d7cb-49b0-929c-9ebac4a78377 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:39.835799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:39.836492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:39.843786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:39.844563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:39.860749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:39.865219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3ba80-3e18-4639-b636-b88b1ec013ce service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:39.912040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 815/1649] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:42.329447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:42.330539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:42.330984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:42.390392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] MFA Rules not processed for user `c669b834d35c4822ac0602155b3007bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:42.391887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:42.405625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:42.513361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996bf5-dc48-48a3-9bd7-e61cf4ae5066 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:42.514213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996bf5-dc48-48a3-9bd7-e61cf4ae5066 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:42.514294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8996bf5-dc48-48a3-9bd7-e61cf4ae5066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:42.514809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 835/1650] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:42.541016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e8996bf5-dc48-48a3-9bd7-e61cf4ae5066 None None] MFA Rules not processed for user `c669b834d35c4822ac0602155b3007bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:42.544761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e8996bf5-dc48-48a3-9bd7-e61cf4ae5066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:42.554956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 816/1651] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:09:42.568566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:42.584732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157395f-d94d-4169-8615-c11e734921d8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:42.592089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:42.592920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:42.593390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:42.593617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:42.604296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:42.606298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:42.622891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 836/1652] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:42.938891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754f8c-5984-458a-a061-75c50678a599 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:42.941891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754f8c-5984-458a-a061-75c50678a599 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:42.943228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754f8c-5984-458a-a061-75c50678a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:42.972156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b0754f8c-5984-458a-a061-75c50678a599 None None] MFA Rules not processed for user `f5464624509844deaac583112045530c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:42.973718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0754f8c-5984-458a-a061-75c50678a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:42.985197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 817/1653] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:43.003146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:43.119598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6159e-340b-4c39-b51d-1aff66493713 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:43.135851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:43.135851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.135851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.135851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] PATH_INFO: `/v3/users/07745a554ef64cfe878a418fd4e34503` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.136213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07745a554ef64cfe878a418fd4e34503)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:43.136213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:43.136213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 25 06:09:43.136213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: Jul 25 06:09:43.136213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:43.140423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73a75-2cf8-4d78-a2d4-51ccb65dad55 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.151705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73a75-2cf8-4d78-a2d4-51ccb65dad55 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.151705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb73a75-2cf8-4d78-a2d4-51ccb65dad55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.190908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-acb73a75-2cf8-4d78-a2d4-51ccb65dad55 None None] MFA Rules not processed for user `10875af9fd904150ac8baac0a4c83a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:43.192417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-acb73a75-2cf8-4d78-a2d4-51ccb65dad55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:43.224969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:43.398270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 818/1654] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:43.408619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97d2c-cadc-434e-aa58-7112cf0d4280 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.409041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97d2c-cadc-434e-aa58-7112cf0d4280 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.409477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d97d2c-cadc-434e-aa58-7112cf0d4280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.431332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07745a554ef64cfe878a418fd4e34503'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:43.434164 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07745a554ef64cfe878a418fd4e34503'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:43.438417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07745a554ef64cfe878a418fd4e34503'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:43.452768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-44d97d2c-cadc-434e-aa58-7112cf0d4280 None None] MFA Rules not processed for user `10875af9fd904150ac8baac0a4c83a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:43.454033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-44d97d2c-cadc-434e-aa58-7112cf0d4280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:43.475476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07745a554ef64cfe878a418fd4e34503'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:43.481812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 819/1655] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:09:43.579504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6ca6ef9d-365f-46ec-ad5c-d551e408232a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07745a554ef64cfe878a418fd4e34503'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:43.726754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 837/1656] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:43 2022] DELETE /identity/v3/users/07745a554ef64cfe878a418fd4e34503 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:43.728006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.728832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.729293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.764739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:43.770667 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:43.864890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1f50-a5e9-422a-88dc-993cec08130e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.865348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1f50-a5e9-422a-88dc-993cec08130e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.865460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d1f50-a5e9-422a-88dc-993cec08130e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.866888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 838/1657] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jul 25 06:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:09:43.875615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:43.875828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:43.876121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:43.943444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:43.952702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 820/1658] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:43.969806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:43.971340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.008990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:44.014965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.103920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 839/1659] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:09:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:44.122485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:44.124054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.143011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e8137-e06f-4b24-94f5-d42ff23d9e8c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:44.153295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:44.153989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.154284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.154570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.164913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:44.167458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfd5fd-06c5-4a1c-a8c5-4d3474a0e475 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:44.177000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370d20a-55c0-44cc-9aa5-f7bcf808a4f9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:44.181838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:44.185316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 840/1660] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:44.187137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605d2f-2b96-407f-a3ad-92c8268422fe None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.187631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605d2f-2b96-407f-a3ad-92c8268422fe None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.187924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605d2f-2b96-407f-a3ad-92c8268422fe None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.189365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 841/1661] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jul 25 06:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:44.194874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.195268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.195582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.209883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.210208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.210480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.214160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:44.215829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:44.244693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 821/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:09:44.247915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:44.255567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.264943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:44.266637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.293537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 842/1663] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:09:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:44.304253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf058d-4f19-47b9-a913-403c6007bf20 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:44.307768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:44.316731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:44.319487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656a7a2-849d-4eea-8e51-264ca18c0774 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:44.322472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.322891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.324060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] PATH_INFO: `/v3/users/368ce69362a248da810f646c395c4dfa` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.327933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] RBAC: Authorizing `identity:delete_user(user_id=368ce69362a248da810f646c395c4dfa)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:44.336340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:44.345541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:44.351135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.351135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.351135 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.360669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:44.362118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bdd8dd-86d5-430d-86d0-27560afd8df3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:44.387263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 843/1664] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:09:44.641823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.642430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.642523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.698415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '368ce69362a248da810f646c395c4dfa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:44.709133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:44.732637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] MFA Rules not processed for user `cb480fa8195647cfa6bcf3c5383b9229`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:44.741788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.802308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '368ce69362a248da810f646c395c4dfa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:44.898490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '368ce69362a248da810f646c395c4dfa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:44.914636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '368ce69362a248da810f646c395c4dfa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:44.916147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b2bbfc7-baa4-4e28-9b35-de4b5b36716e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '368ce69362a248da810f646c395c4dfa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:44.931585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 822/1665] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:44 2022] DELETE /identity/v3/users/368ce69362a248da810f646c395c4dfa => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:44.933768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:44.933768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:44.934281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:44.978849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:44.980207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:44.986010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 844/1666] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:45.320960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 823/1667] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:45.331478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:45.335130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:45.374751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94ade8d-0e65-480e-bef8-058e099b3d42 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:45.467606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:45.471694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:45.522509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656259ef-0e24-4e92-b68f-071b76f20aba None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:45.524231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:45.525572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:45.526032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:45.526389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:45.526638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] PATH_INFO: `/v3/users/bef94a2d83844179aa3976a0a133a727` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:45.527174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:45.527525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:45.527892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:45.529611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef94a2d83844179aa3976a0a133a727)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:45.532580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:45.553531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:45.559650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:45.612027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 845/1668] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:45.613244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:45.617954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:45.661373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d342a74-bd8f-4d98-aa30-69b339f81f7a service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:45.674146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:45.675318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:45.675987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:45.677166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] PATH_INFO: `/v3/projects/28125bc085d54714a5214be89b5fc2ec` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:45.678785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28125bc085d54714a5214be89b5fc2ec)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:45.681058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:45.734494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:45.826234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef94a2d83844179aa3976a0a133a727'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.832302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28125bc085d54714a5214be89b5fc2ec', 'request_id': 'req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.849246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28125bc085d54714a5214be89b5fc2ec', 'request_id': 'req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.866518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef94a2d83844179aa3976a0a133a727'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.954736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28125bc085d54714a5214be89b5fc2ec', 'request_id': 'req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.994634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] The token cache is being invalidate because project 28125bc085d54714a5214be89b5fc2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:45.995201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:45.996400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:46.002108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 846/1669] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:45 2022] DELETE /identity/v3/projects/28125bc085d54714a5214be89b5fc2ec => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:46.003603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:46.006387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.048329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef94a2d83844179aa3976a0a133a727'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:46.056771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef94a2d83844179aa3976a0a133a727'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:46.060255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-00630ddf-64e9-4ee5-ba6a-fdc1e703de14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef94a2d83844179aa3976a0a133a727'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:46.090518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 824/1670] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:45 2022] DELETE /identity/v3/users/bef94a2d83844179aa3976a0a133a727 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:46.100541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f1fc-198f-4894-8399-7e705451aefa None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.105015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f1fc-198f-4894-8399-7e705451aefa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.105015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4f1fc-198f-4894-8399-7e705451aefa None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.106088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 825/1671] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jul 25 06:09:46 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:09:46.117536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.117835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.118140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.164438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:46.166212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.209521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf1682-f7f9-49c0-9bc5-6ebc71c2c581 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:46.383660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:46.440185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 826/1672] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:46.450681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:46.454911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.488326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:46.490584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.490876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.496281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.500441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.618064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84482-cea6-4d4b-808b-4892a4d2ff02 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:46.636273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:46.637161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.637496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.639257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.642541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.652130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:46.683040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:46.686994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d4463-70f8-4dce-941d-3cc6c7234593 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:46.690512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:46.694117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cbabd-fea2-4142-b539-fc0ad6337ea2 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:46.725623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 827/1673] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:46.728127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.728433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.730909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.733666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 847/1674] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:46.735761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a126-ce78-4153-87e7-2335cab5873b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.736072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a126-ce78-4153-87e7-2335cab5873b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.736355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87a126-ce78-4153-87e7-2335cab5873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.777001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:46.782880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.785893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7e87a126-ce78-4153-87e7-2335cab5873b None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:46.787471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7e87a126-ce78-4153-87e7-2335cab5873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.815545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 828/1675] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:46.816619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:46.819004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.842118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 848/1676] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jul 25 06:09:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:46.843464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.845878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.846171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.849729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701630b8-3f17-4cb4-9560-ce9e73e8c429 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:46.865340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:46.866247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:46.872925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:46.872925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] PATH_INFO: `/v3/users/8e265bde3a5c47efbb58bc5feac48e4f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:46.872925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e265bde3a5c47efbb58bc5feac48e4f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:46.878753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:46.907279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:46.912635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.952132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 849/1677] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:46.953271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:46.961724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:46.993562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18054ed-832a-47b2-bb80-7eaf5b6207cd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:46.999457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:47.002727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.004035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:47.005169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] PATH_INFO: `/v3/projects/f33b1938a5b946c6af0fda92bdc6b714` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:47.009873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33b1938a5b946c6af0fda92bdc6b714)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:47.012488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:47.143709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e265bde3a5c47efbb58bc5feac48e4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.176521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e265bde3a5c47efbb58bc5feac48e4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.300108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33b1938a5b946c6af0fda92bdc6b714', 'request_id': 'req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.316277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33b1938a5b946c6af0fda92bdc6b714', 'request_id': 'req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.354199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e265bde3a5c47efbb58bc5feac48e4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.375102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e265bde3a5c47efbb58bc5feac48e4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.376445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e265bde3a5c47efbb58bc5feac48e4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.390654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 829/1678] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:46 2022] DELETE /identity/v3/users/8e265bde3a5c47efbb58bc5feac48e4f => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:47.394070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:47.396416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.456031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33b1938a5b946c6af0fda92bdc6b714', 'request_id': 'req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.475733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] The token cache is being invalidate because project f33b1938a5b946c6af0fda92bdc6b714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:47.476478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.477689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:47.479547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 850/1679] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:46 2022] DELETE /identity/v3/projects/f33b1938a5b946c6af0fda92bdc6b714 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:47.480731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:47.484050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.519149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b8527-aa08-4fa6-b6e0-4c833a2fc61f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:47.527702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:47.528403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.528798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:47.529081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:47.532675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.649456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f0b1-91f3-4648-93a3-c3a6c6cf0c6c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:47.708658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:47.711078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:47.735796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 830/1680] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:47.738004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:47.749248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:47.750029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.750417 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:47.750796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:47.752907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.762419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.766095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:47.768651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be10e4f-804b-4223-9984-7015323c9e24 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:47.808083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 851/1681] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:47.814533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.814533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:47.814533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:47.841963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e48378-46fa-44c4-bfa7-04d2440c5a1f service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:47.858941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:47.859867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.860341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:47.860716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:47.861997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:47.862412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:47.865245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:47.898052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:47.899407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.931951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 831/1682] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:47.933222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:47.936387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:47.946469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 852/1683] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:47.946469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:47.968173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806a595-75c6-4ba8-bb64-f5cae250eb41 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:47.996880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:47.996880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:47.997344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.001518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] PATH_INFO: `/v3/users/460d4f3b21144a5db251504b846a2bc6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.002488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3e8b5-5db7-4f14-bd89-18268daa3bca None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:48.003803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=460d4f3b21144a5db251504b846a2bc6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.008207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:48.031406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:48.031406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.031406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.031406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.037248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.050092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:48.083315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:48.255371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 853/1684] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:47 2022] POST /identity/v3/projects => generated 361 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:48.257338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:48.269228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:48.394069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448593-6e4f-47ef-a5c6-5d14f2642be3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:48.394736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460d4f3b21144a5db251504b846a2bc6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:48.401224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:48.402249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.402642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.403070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.452316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460d4f3b21144a5db251504b846a2bc6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:48.497680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.502155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:48.511747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:48.540756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 854/1685] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:48.547316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:48.576694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460d4f3b21144a5db251504b846a2bc6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:48.586846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265d3a9-688f-4f15-a93e-bd51ca6b47f7 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:48.588370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460d4f3b21144a5db251504b846a2bc6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:48.589284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-22a13bc9-ee48-463c-9374-00b979519e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460d4f3b21144a5db251504b846a2bc6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:48.606015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:48.606912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.607349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.608413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.609764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.614392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:48.622753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 832/1686] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:47 2022] DELETE /identity/v3/users/460d4f3b21144a5db251504b846a2bc6 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:48.661486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.661838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.662128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.685583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] MFA Rules not processed for user `10875af9fd904150ac8baac0a4c83a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:48.687163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:48.747459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 855/1687] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:48 2022] POST /identity/v3/users => generated 281 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:48.752617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:48.763641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:48.776980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 833/1688] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:48.795711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:48.799374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:48.805070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05ad1c-155a-4b38-b5e3-a1a3af37fa2d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:48.936859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74e3e1-86c9-493d-93ee-d4364ea7cfc8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:48.946464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:48.947368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.947718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.949109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] PATH_INFO: `/v3/projects/b156d96af60346eb82fb32eb73350e28` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.950687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b156d96af60346eb82fb32eb73350e28)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.952641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: WARNING py.warnings [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 06:09:48.952641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: warnings.warn(msg) Jul 25 06:09:48.952641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: Jul 25 06:09:48.954293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:48.954985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:48.955296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:48.955599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:48.956357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:48.968308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:48.972164 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:49.009114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 856/1689] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:49.013183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:49.044106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4257f7-3fc0-4515-8d6c-057403ffc863 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:49.063090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:49.064011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:49.065470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:49.067372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:49.069886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:49.075128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:49.095641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 857/1690] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:49.101610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:49.141598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00b61e-3eff-424b-b79d-adfe8f913263 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:49.189079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b156d96af60346eb82fb32eb73350e28', 'request_id': 'req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:49.212450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b156d96af60346eb82fb32eb73350e28', 'request_id': 'req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:49.312091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:49.313282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:49.313657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:49.313967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] PATH_INFO: `/v3/projects/853a2f438cdd4150a5cccb2e8d5200d2/users/de89e228cf7749b3b2137f67cf4594b6/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:49.335493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853a2f438cdd4150a5cccb2e8d5200d2, user_id=de89e228cf7749b3b2137f67cf4594b6, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:49.340195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ecbb3-35ae-48d9-bd04-a1bf1e7f8a15 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:49.399506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b156d96af60346eb82fb32eb73350e28', 'request_id': 'req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:49.421224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] The token cache is being invalidate because project b156d96af60346eb82fb32eb73350e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:49.421516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:49.422369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:49.424418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 834/1691] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:48 2022] DELETE /identity/v3/projects/b156d96af60346eb82fb32eb73350e28 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:09:49.429052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:49.430813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:49.449054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 858/1692] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:49 2022] PUT /identity/v3/projects/853a2f438cdd4150a5cccb2e8d5200d2/users/de89e228cf7749b3b2137f67cf4594b6/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:49.460799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:49.461404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:49.461921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:49.468763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3e17-ef5d-4c9b-87cb-e8bcecacb87e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:49.554452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] MFA Rules not processed for user `de89e228cf7749b3b2137f67cf4594b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:49.574771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:49.654839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:49.657271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:49.659538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:49.659992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] PATH_INFO: `/v3/users/922e14ab4c0b4386a3d9601bf9a6d856` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:49.667500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=922e14ab4c0b4386a3d9601bf9a6d856)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:49.677346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:49.758385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 859/1693] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:49.759635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:49.774185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:49.809844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190bea0-cc92-47f4-835f-00948d4ce7e5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:49.815748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:49.817449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:49.817740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:49.818019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] PATH_INFO: `/v3/projects/e07ecf0ed022414287428c05ef795920` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:49.819616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07ecf0ed022414287428c05ef795920)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:49.831876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:49.986497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922e14ab4c0b4386a3d9601bf9a6d856'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.013482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07ecf0ed022414287428c05ef795920', 'request_id': 'req-d5cd4851-df0f-423c-a2e0-adc2419c7df7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.015928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922e14ab4c0b4386a3d9601bf9a6d856'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.024272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07ecf0ed022414287428c05ef795920', 'request_id': 'req-d5cd4851-df0f-423c-a2e0-adc2419c7df7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.075644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07ecf0ed022414287428c05ef795920', 'request_id': 'req-d5cd4851-df0f-423c-a2e0-adc2419c7df7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.105157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] The token cache is being invalidate because project e07ecf0ed022414287428c05ef795920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:50.106107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.106974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.109668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 860/1694] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:49 2022] DELETE /identity/v3/projects/e07ecf0ed022414287428c05ef795920 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:50.110749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:50.112402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.194238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922e14ab4c0b4386a3d9601bf9a6d856'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.203715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922e14ab4c0b4386a3d9601bf9a6d856'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.204087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd4851-df0f-423c-a2e0-adc2419c7df7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:50.204626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922e14ab4c0b4386a3d9601bf9a6d856'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.209173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:50.210057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.210346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.210637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] PATH_INFO: `/v3/projects/071eec02b23242a2be9dd63d2651b85e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.211867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=071eec02b23242a2be9dd63d2651b85e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:50.212726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 835/1695] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:49 2022] DELETE /identity/v3/users/922e14ab4c0b4386a3d9601bf9a6d856 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:09:50.213748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:50.214061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:50.232714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.321473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc89dc52-2707-44fb-998f-027891dd7b1e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:50.328938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:50.329941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.330414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.331184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.334034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.430483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:50.435851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:50.438035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4030a50-16c6-47a8-8cf6-e1f41b14afcf service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:50.442612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '071eec02b23242a2be9dd63d2651b85e', 'request_id': 'req-84aa3a42-539f-4c1d-839e-1399edaa06b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.456629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '071eec02b23242a2be9dd63d2651b85e', 'request_id': 'req-84aa3a42-539f-4c1d-839e-1399edaa06b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.481863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 836/1696] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:50.483855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f44e0-ac87-4be0-b4a0-a7c0108d105e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.485691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f44e0-ac87-4be0-b4a0-a7c0108d105e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.485691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f44e0-ac87-4be0-b4a0-a7c0108d105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.526110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f58f44e0-ac87-4be0-b4a0-a7c0108d105e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:50.527349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f58f44e0-ac87-4be0-b4a0-a7c0108d105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.529920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '071eec02b23242a2be9dd63d2651b85e', 'request_id': 'req-84aa3a42-539f-4c1d-839e-1399edaa06b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.570462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] The token cache is being invalidate because project 071eec02b23242a2be9dd63d2651b85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:50.570995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.571978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:50.589889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 861/1697] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:50 2022] DELETE /identity/v3/projects/071eec02b23242a2be9dd63d2651b85e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:50.590993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:50.595377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.761409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 837/1698] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:50.762853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa100be6-dcd5-43da-b4c5-b41440a96573 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.763208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa100be6-dcd5-43da-b4c5-b41440a96573 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.763568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa100be6-dcd5-43da-b4c5-b41440a96573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.790993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa3a42-539f-4c1d-839e-1399edaa06b6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:50.801080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fa100be6-dcd5-43da-b4c5-b41440a96573 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:50.802406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fa100be6-dcd5-43da-b4c5-b41440a96573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.811396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:50.813335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.814966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.817026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] PATH_INFO: `/v3/users/de89e228cf7749b3b2137f67cf4594b6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.820058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de89e228cf7749b3b2137f67cf4594b6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:50.824318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:50.841696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:50.847099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 838/1699] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:50.850090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cd75-d8a0-43bf-9302-022ec5ec7b19 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.851881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cd75-d8a0-43bf-9302-022ec5ec7b19 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.852379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549cd75-d8a0-43bf-9302-022ec5ec7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.878936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f549cd75-d8a0-43bf-9302-022ec5ec7b19 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:50.884960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f549cd75-d8a0-43bf-9302-022ec5ec7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.923545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 839/1700] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:50.923545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.923545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.923545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.944591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:50.945816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:50.954151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 840/1701] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:50.954869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:50.966850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5c980-249d-47ba-8a3b-5445d717e5e8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:50.971657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:50.972434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:50.972809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:50.974007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:50.974007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:50.974323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:50.976087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:50.990572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 841/1702] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:50.991649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.002022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4e7dd-f337-4f30-b8c2-540deee789c4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.007362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.008004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.008293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.008811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.009497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:51.009811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.011431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.041459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 842/1703] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:51.049729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.061835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dbf99-a9b3-4d1c-8d78-938be476b4d8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.068265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.069642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.069642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.069642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.070554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.072945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.116207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de89e228cf7749b3b2137f67cf4594b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.116886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de89e228cf7749b3b2137f67cf4594b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.117508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de89e228cf7749b3b2137f67cf4594b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.125109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de89e228cf7749b3b2137f67cf4594b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.138140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de89e228cf7749b3b2137f67cf4594b6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.221147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 843/1704] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/projects => generated 405 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:51.222292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.225014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.264552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 862/1705] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:50 2022] DELETE /identity/v3/users/de89e228cf7749b3b2137f67cf4594b6 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:51.268867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.271224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.311096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d97a-956d-4478-bcad-0a35facf6799 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.378657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e611e10-8870-490d-8cf6-f699a5a9e22b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.389963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.390956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.391249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.391542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] PATH_INFO: `/v3/projects/477752b81bf14190b97292658f184a5d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.392999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.393841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.394130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.394494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.395902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.396813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] RBAC: Authorizing `identity:delete_project(project_id=477752b81bf14190b97292658f184a5d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.398244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.400053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.553642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 863/1706] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:51.553642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.558737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.586303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477752b81bf14190b97292658f184a5d', 'request_id': 'req-c0dfc975-a203-4423-aa24-d3835f93704f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.601816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477752b81bf14190b97292658f184a5d', 'request_id': 'req-c0dfc975-a203-4423-aa24-d3835f93704f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.685223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477752b81bf14190b97292658f184a5d', 'request_id': 'req-c0dfc975-a203-4423-aa24-d3835f93704f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.723415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] The token cache is being invalidate because project 477752b81bf14190b97292658f184a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:51.724632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.726043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c0dfc975-a203-4423-aa24-d3835f93704f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:51.728552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42ceb4-9608-4cce-8cea-2b2db1b6b225 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.734438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.749074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.749074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.749074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.749074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.749789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 844/1707] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:51 2022] DELETE /identity/v3/projects/477752b81bf14190b97292658f184a5d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:51.749872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee182135-1c1e-4c8d-836a-b6867d8fe4b7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.749944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.749944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.749944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.791768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:51.794530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.804504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 845/1708] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:51.805519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.807190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.835660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a54a7f-e45d-410c-a390-431d8cddeb89 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.844476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.846211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.846623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.847211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.848794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.852449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:51.857782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 864/1709] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/users => generated 303 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:51.857782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.857782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.857782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.888381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:51.891799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.901469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 865/1710] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:51.902584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.911676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.951754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 846/1711] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:51 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:51.951754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:51.954866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:51.969533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dce3d-21b4-4f37-9bfe-f172d3d438ac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:51.979756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:51.981045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:51.981976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:51.982276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:51.983027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:51.988034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97539443-f425-46a2-80c6-8cd27217e458 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.005965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 847/1712] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:52.006768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490d1c3-238e-4cfd-8086-411a6346ff36 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.010262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.010575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.010857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.024445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.025891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.026189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.026495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.040391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:52.042223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:52.112343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 848/1713] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:52.112343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.113066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.113066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.113217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40827b3-1c69-44b6-9a07-60d1b7549682 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.113217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.113217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.113217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.114023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.114023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.114023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.114801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 866/1714] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:52.114801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.115208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 849/1715] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:52.115208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.121404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29447a-d5b2-4411-b1ad-7603ecba4400 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.124300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23befc6-3849-4b6a-b440-39c673ce11be service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.134143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.134838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.135128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.135412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.136196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:52.136512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.139111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.140202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.140450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.140757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.141567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.143174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.143756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.154992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 867/1716] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:52.155927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.164131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 850/1717] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:52.165315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.179414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f32e2-a0f5-4435-99d6-b88af08414c0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.184921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7745d-c0f9-4cc8-8225-2b55a9ca2c52 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.188050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.188644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.189197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.189702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.189990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.190192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.190341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] PATH_INFO: `/v3/projects/4572bc6ffa8b461592062fc8a2ac735c/users/8cee16023ea5413b9b775cebaa0e9174/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.190796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.192313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.194245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.212851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4572bc6ffa8b461592062fc8a2ac735c, user_id=8cee16023ea5413b9b775cebaa0e9174, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.217641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 868/1718] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:52.217769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.217867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.229850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc79e2bf-d30d-4632-803d-5ac12ccfc03f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.235139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.235840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.236123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.236650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.237690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.247938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f815f04-945e-4d1e-8042-a1067ca566d3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.309702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 851/1719] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:52 2022] PUT /identity/v3/projects/4572bc6ffa8b461592062fc8a2ac735c/users/8cee16023ea5413b9b775cebaa0e9174/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:52.315239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.342197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:52.409362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33048474-a5b1-4725-bb17-c13a63837b05 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.415184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 869/1720] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:52.415521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.415846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.416126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.419283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.454644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.454644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.454644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] PATH_INFO: `/v3/projects/d76266a5146545baa3fc7bc6fe41bb06/users/05fb1960b5d24d81b585b4bf5818e8b3/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.454644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d76266a5146545baa3fc7bc6fe41bb06, user_id=05fb1960b5d24d81b585b4bf5818e8b3, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.454644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.455942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:52.455942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:52.523697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 870/1721] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:52.523697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.532721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799b81c-d1f7-46c3-bc62-371402e8a6fb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.538626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.539593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.540422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.541285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.542432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.545025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add657c-3f5b-4044-b42a-66d6f1b94793 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.547091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:52.554293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 852/1722] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:52 2022] PUT /identity/v3/projects/d76266a5146545baa3fc7bc6fe41bb06/users/05fb1960b5d24d81b585b4bf5818e8b3/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:52.556460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.558240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:52.643803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 871/1723] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:52.645372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234193d2-0f86-49e7-b937-361349ad7596 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.645733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234193d2-0f86-49e7-b937-361349ad7596 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.647620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234193d2-0f86-49e7-b937-361349ad7596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.663065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49526f9e-10d3-4ee8-b853-c7ebf2b25c32 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.668040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.671272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.671272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.671272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.722470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-234193d2-0f86-49e7-b937-361349ad7596 None None] MFA Rules not processed for user `05fb1960b5d24d81b585b4bf5818e8b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:52.725094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-234193d2-0f86-49e7-b937-361349ad7596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:52.815441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.820188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.866153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 853/1724] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:52.869660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.903007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb317075-4e80-446b-9e17-446f260122ee service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:52.919229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:52.920164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.920519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.920922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.922044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:52.926995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:52.954889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 872/1725] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:52.956600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:52.957068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:52.957487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:52.968517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 854/1726] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:52.975127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:52.981963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:53.017130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809298f7-7d74-480f-8f62-53ef26b0b33d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:53.023611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:53.024472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.024758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.025037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] PATH_INFO: `/v3/projects/853a2f438cdd4150a5cccb2e8d5200d2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.026270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=853a2f438cdd4150a5cccb2e8d5200d2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:53.028923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:53.092130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:53.102748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:53.251626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853a2f438cdd4150a5cccb2e8d5200d2', 'request_id': 'req-736a7179-2796-45e2-a14a-1b45d4ac9f7b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:53.267872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853a2f438cdd4150a5cccb2e8d5200d2', 'request_id': 'req-736a7179-2796-45e2-a14a-1b45d4ac9f7b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:53.295031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 873/1727] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:09:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:53.297862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:53.324908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fc75c-e3dd-4709-a98c-f6638994ffe5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:53.436625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:53.437593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.438175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.438778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.439885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:53.442279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49d3b2-2c4d-46da-b030-95367fb6ed04 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:53.482383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853a2f438cdd4150a5cccb2e8d5200d2', 'request_id': 'req-736a7179-2796-45e2-a14a-1b45d4ac9f7b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:53.573775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] The token cache is being invalidate because project 853a2f438cdd4150a5cccb2e8d5200d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:09:53.574084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:53.577380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:09:53.582764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 855/1728] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:09:52 2022] DELETE /identity/v3/projects/853a2f438cdd4150a5cccb2e8d5200d2 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:53.590298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:53.604347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:53.627289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a7179-2796-45e2-a14a-1b45d4ac9f7b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:53.632477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:53.633174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.633457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.633735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.634518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:53.636163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:53.654384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 874/1729] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:53 2022] POST /identity/v3/projects => generated 377 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:53.655853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.656146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.656429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.665505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 856/1730] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:53.668291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:53.672665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:53.698863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:53.700380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:53.703985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccd374-cef0-44c0-89ae-1ee96d69b3bc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:53.803035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 875/1731] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:53.804409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:53.816813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ea76a9-6d7f-4dfb-84ce-47adfe8b9e3d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:53.823014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:53.824357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.824750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.825130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] PATH_INFO: `/v3/projects/ccb9bce9fea34d4d87dffa44eb7d0dfd/users/47bef1866ff54f62831e86c984548268/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.829909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:53.830655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:53.830947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:53.831230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:53.832006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:53.834720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:53.848550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb9bce9fea34d4d87dffa44eb7d0dfd, user_id=47bef1866ff54f62831e86c984548268, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:53.848550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ca8ce-5558-4f84-9d47-25a11c14ef22 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.018020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 876/1732] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:53 2022] PUT /identity/v3/projects/ccb9bce9fea34d4d87dffa44eb7d0dfd/users/47bef1866ff54f62831e86c984548268/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:54.020109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d4c7-4850-4e45-a267-2e06d86e3237 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.020476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d4c7-4850-4e45-a267-2e06d86e3237 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.021032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184d4c7-4850-4e45-a267-2e06d86e3237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.037822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 857/1733] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:53 2022] POST /identity/v3/users => generated 295 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:54.038956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.044720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:54.070334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6184d4c7-4850-4e45-a267-2e06d86e3237 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:54.071949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6184d4c7-4850-4e45-a267-2e06d86e3237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:54.241757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 877/1734] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:54.246691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.247003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.247301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.278330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:54.320227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] MFA Rules not processed for user `47bef1866ff54f62831e86c984548268`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:54.320227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:54.338330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045a7c9e-a081-4ea9-84a2-be3eb2a1af70 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:54.450925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 878/1735] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:54.452307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.463090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:54.467343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.467343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.467343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.470985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:54.486655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc24730-ec26-4540-8579-b69f5d8b7246 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:54.492542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:54.502871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.502871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.502871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.502871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:54.502871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.511593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 879/1736] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:54.512725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.529452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899097a-a3be-4dd3-a9a2-b38093bb64fb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:54.534690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:54.536120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.536733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.537083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.537965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:09:54.537965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:54.552039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:54.554177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.605895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 880/1737] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:09:54.608956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.636532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:54.642265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.677420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b6e92-7c8a-4505-8099-96463c664108 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:54.699486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 858/1738] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:09:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:09:54.700919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.716174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:54.717142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.717142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.717395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.727148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:54.727834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de428638-b869-43ab-bb4b-c372d2893b00 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:54.737675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.750608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:54.751540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:54.751883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:54.752164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] PATH_INFO: `/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb/users/1b2ccbde1a9d45e0a8480783a42b94f8/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:54.810350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c703e3e47ff148cbbf97004fe6e38fdb, user_id=1b2ccbde1a9d45e0a8480783a42b94f8, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:54.813288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:54.951744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 881/1739] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:54 2022] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:54.952498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:54.980151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 859/1740] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:54 2022] PUT /identity/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb/users/1b2ccbde1a9d45e0a8480783a42b94f8/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:54.981212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.147934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0e976-db9d-4bfd-a846-b34518d449ae admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.233360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.234397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.234867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.235826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.236892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.241203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.246492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627d6327-17fc-4c2d-8887-2e5939886847 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.273145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.275209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.275209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.275209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.275209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.286098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.451286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 882/1741] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:54 2022] POST /identity/v3/projects => generated 377 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:55.458232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.475315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 860/1742] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:54 2022] POST /identity/v3/users => generated 292 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:55.475315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.509619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372684d-3364-442b-9ffb-b90b39263287 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.650512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f507f1-0f12-4473-b1da-0fed172e30fa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.658069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.659801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.660160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.661057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.661920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.665222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.680669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.681568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 883/1743] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:55.683168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.685520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.686089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.687794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.688748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.694798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f2456-c47c-4aa9-94af-19db67e89c0b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.699218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6eee8-385d-4a27-935e-38304d176017 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.706935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.710282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.710973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.711337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.712950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.715647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.739590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 884/1744] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:55.742038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.774820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7d287-b42c-462a-b549-356f15ef96f7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:55.789149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:55.790384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.791461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.791856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] PATH_INFO: `/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb/users/1b2ccbde1a9d45e0a8480783a42b94f8/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.798737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c703e3e47ff148cbbf97004fe6e38fdb, user_id=1b2ccbde1a9d45e0a8480783a42b94f8, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:55.803242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:55.840875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 885/1745] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:55 2022] PUT /identity/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb/users/1b2ccbde1a9d45e0a8480783a42b94f8/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:55.842100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:55.908313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 861/1746] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:55 2022] POST /identity/v3/users => generated 289 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:55.913136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:55.913136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:55.913136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:55.992660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f292f25-a485-42f0-b4f3-acba2f4a991d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.006797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.007820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.010813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.010813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] PATH_INFO: `/v3/projects/04b224b5c6ad467aae124e644ee62896/users/0938560248ab4516bd3a6df179717fda/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.015946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] MFA Rules not processed for user `1b2ccbde1a9d45e0a8480783a42b94f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:56.017519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:56.044585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b224b5c6ad467aae124e644ee62896, user_id=0938560248ab4516bd3a6df179717fda, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.047921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.149661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 886/1747] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:55 2022] PUT /identity/v3/projects/04b224b5c6ad467aae124e644ee62896/users/0938560248ab4516bd3a6df179717fda/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:56.150649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.218946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 862/1748] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:56.220053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.248394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7265-af61-46cf-9e7c-eb03a8f755a1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.299882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601d341-b0cd-4598-a6cd-c7b8fdf29bc5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.319281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.319704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.319994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.320267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.320988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.322806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.339216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:56.353259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 887/1749] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:56.356218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.368579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:56.382225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.386515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.386515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.386515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.386515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.389480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.421235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 863/1750] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:56.421645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.432829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:56.454922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1c7ff-35c6-42f3-bbf3-629fab880bf0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.471490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.472627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.473732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.474583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.475892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.478338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.502709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 864/1751] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:56.504108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.521175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d183232-6566-4fb4-957f-7f6e5869524e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.532053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.533549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.534067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.534793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] PATH_INFO: `/v3/projects/04b224b5c6ad467aae124e644ee62896/users/0938560248ab4516bd3a6df179717fda/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.538896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b224b5c6ad467aae124e644ee62896, user_id=0938560248ab4516bd3a6df179717fda, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.544114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.565264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 865/1752] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:56 2022] PUT /identity/v3/projects/04b224b5c6ad467aae124e644ee62896/users/0938560248ab4516bd3a6df179717fda/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:56.566144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:56.580517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ad8d2-5206-4197-a458-47352ac894ea admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.739738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.741284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.741652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.741939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.744096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:56.756453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087580d-b694-439e-9c35-8d508ff31e7f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:56.778247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:56.779471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.780009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.780504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] PATH_INFO: `/v3/projects/a897fca373594c2da77493e1e50802ad/users/39b877c33f114e6992f4f68ae98858bc/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.821309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a897fca373594c2da77493e1e50802ad, user_id=39b877c33f114e6992f4f68ae98858bc, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.829390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38917cb9-692e-4e41-81fa-794ddd9b6dc2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.834754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:56.836470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089428c4-0b0d-4df3-a0f1-dbe4a6f422ed service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:56.864809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 888/1753] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:56.867293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5127ae-635a-469f-9e45-9ac69a04b917 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.867603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5127ae-635a-469f-9e45-9ac69a04b917 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.868514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5127ae-635a-469f-9e45-9ac69a04b917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:56.944152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8d5127ae-635a-469f-9e45-9ac69a04b917 None None] MFA Rules not processed for user `0938560248ab4516bd3a6df179717fda`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:56.944287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 866/1754] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:56 2022] PUT /identity/v3/projects/a897fca373594c2da77493e1e50802ad/users/39b877c33f114e6992f4f68ae98858bc/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:56.954289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8d5127ae-635a-469f-9e45-9ac69a04b917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:56.954745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:56.955150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:56.955544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:57.030038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] MFA Rules not processed for user `39b877c33f114e6992f4f68ae98858bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:57.038696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:57.313770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 889/1755] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:57.316337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 867/1756] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:57.318680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:57.318680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:57.318680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:57.319341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:57.323178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:57.324546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:57.502139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 890/1757] 10.222.0.18 () {58 vars in 1015 bytes} [Mon Jul 25 06:09:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:57.504607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:57.507328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:57.556589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18c297-9ba3-42e0-8fa3-a29b67e221d3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:57.584224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:57.585005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:57.585401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:57.585836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:57.586647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:57.588811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:57.690773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b44e63-16bd-4090-a3af-5ceed8d33b05 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:57.701446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:57.702252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:57.704187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:57.704589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:57.718480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:57.720926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:57.740598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 891/1758] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:57.743211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:57.750701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:57.791339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ec45-b6bd-4239-b180-ae779aa3f88c service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:57.795890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:57.796810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:57.797206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:57.797592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:57.817219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 868/1759] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:57 2022] POST /identity/v3/projects => generated 377 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:57.819492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:57.823987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:57.829983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:57.858063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 892/1760] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:09:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:09:58.026752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addec856-481b-484c-aa06-420d5e23c036 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:58.038986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:58.039772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:58.040065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:58.040370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:58.041065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:58.044229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:58.154538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 869/1761] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:57 2022] POST /identity/v3/users => generated 289 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:09:58.158610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:58.177870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd5861-cfd5-433e-8fdc-d1c2fc78add6 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:58.212581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:58.213996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:58.216076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:58.217630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:58.218649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:58.224379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:58.265805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 893/1762] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:58.269155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:58.300676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b6a76-fc86-4f4a-a6e4-85d50d132893 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:58.337745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:58.338690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:58.339091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:58.339597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:58.340621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:58.344753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82db1-0b48-4786-8dd7-fb6118f28e03 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:58.373565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 870/1763] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:09:58.377940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:58.402333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa866f4-cda2-4a80-90a1-e178ce0b5e48 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:58.430311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:58.431884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:58.432176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:58.432473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] PATH_INFO: `/v3/projects/ac2e6b8da5904261bfbf0b684e5794bb/users/b1a5a5cc51454c1dbc60113f914e6c48/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:58.484631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2e6b8da5904261bfbf0b684e5794bb, user_id=b1a5a5cc51454c1dbc60113f914e6c48, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:58.487505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:58.588367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 894/1764] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:09:58 2022] PUT /identity/v3/projects/ac2e6b8da5904261bfbf0b684e5794bb/users/b1a5a5cc51454c1dbc60113f914e6c48/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:09:58.591173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:58.591662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:58.592109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:58.706088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] MFA Rules not processed for user `b1a5a5cc51454c1dbc60113f914e6c48`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:58.709297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:58.834640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:58.914249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 871/1765] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:58.918718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:58.960562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:09:59.104546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a794978-2337-4345-a425-e6418f0ac07b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:59.125277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:59.126023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:59.126321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:59.130067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:59.131108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:59.135327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276cf271-6318-46db-84fc-5d28c2bf89b2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:59.494442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 895/1766] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:09:58 2022] POST /identity/v3/projects => generated 377 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:09:59.500883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:59.524825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d1051-dc16-474f-96e5-64ad05823e0d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:59.634103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:59.637639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:59.637639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:59.718507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:59.726311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:59.726599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:59.726892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:59.731767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:59.737071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] MFA Rules not processed for user `8cee16023ea5413b9b775cebaa0e9174`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:09:59.741389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:09:59.743434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:09:59.923856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 896/1767] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:09:59 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:09:59.923856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:09:59.923856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cc6fe-f781-4d38-a601-33f35c1faf0d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:09:59.932242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:09:59.933187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:09:59.933971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:09:59.933971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] PATH_INFO: `/v3/users/47bef1866ff54f62831e86c984548268` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:09:59.936502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47bef1866ff54f62831e86c984548268)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:09:59.938676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:00.102750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 872/1768] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:09:59 2022] POST /identity/v3/users => generated 295 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:00.103769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.107547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:00.143524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4909118-0964-4139-8ef0-57a8ba08a278 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:00.165866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:00.167760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.167760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.170161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.170161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:00.171241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:00.250991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47bef1866ff54f62831e86c984548268'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:00.250991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47bef1866ff54f62831e86c984548268'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:00.250991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47bef1866ff54f62831e86c984548268'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:00.253601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 873/1769] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:00 2022] POST /identity/v3/projects => generated 399 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:00.255650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.259645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:00.261194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47bef1866ff54f62831e86c984548268'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:00.281001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47bef1866ff54f62831e86c984548268'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:00.291155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:00.355973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 897/1770] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:09:59 2022] DELETE /identity/v3/users/47bef1866ff54f62831e86c984548268 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:00.357138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.359021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:00.364112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf7cae-f7d3-48d3-8281-3cadcbfd60e2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:00.469223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6baa0e2-7be0-48cd-ac22-849de1eeb526 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:00.475824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:00.476531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.476826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.477223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.477840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:00.480251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf6d41-4357-448f-92dc-b594c75b7f0b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:00.517363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:00.525407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.525763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.527883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.533403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:00.537869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bed87-8ac5-4bdf-b247-8bc28e699dcc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:00.560560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 874/1771] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:00.563421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.563896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.564710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.590703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:00.592721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:00.615147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 875/1772] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:00.616809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.634487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c92b4-ed53-47af-9f0a-9d57a5053cad None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:00.643094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:00.645717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.646163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.647046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] PATH_INFO: `/v3/projects/9c157f5d1fe2484a8771af67e05dd82f/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.681840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c157f5d1fe2484a8771af67e05dd82f, user_id=4baee8fe1ddf4c4c9cba6e46a5f1fb4f, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:00.687670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:00.860081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 898/1773] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:00 2022] POST /identity/v3/users => generated 306 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:00.862316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:00.863942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:00.865234 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:00.874291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 899/1774] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:10:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:10:00.892139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 876/1775] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:00 2022] PUT /identity/v3/projects/9c157f5d1fe2484a8771af67e05dd82f/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:00.899997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.909639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:00.912980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:01.084001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd0a54-19f0-4ed6-a7bd-311a5abe9e0d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.088442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.090491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.090926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.091326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.160728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752408a-ffb5-4846-8334-5863f7bf1276 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.185329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.186418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.195920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.196742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.197037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.197320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.198227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.200067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ec855-73d5-426d-a365-e63dbf1909df admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.205390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 900/1776] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:01.205390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.213728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5353-340b-4dab-bc3a-6ed8cb64f783 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.219982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.230586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.232416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.232977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.234250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.242000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 877/1777] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:01.242000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.242000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.242000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.242730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.288221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 901/1778] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:01.289263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.298310 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:01.303860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:01.340289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff71e6-3923-4b9e-8589-85a1dcea32e1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.362483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.367756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.368138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.368808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] PATH_INFO: `/v3/projects/942324db321044f1b4aaa666258d0943/users/8df8f357a09e4f678134d44d55ea3a3e/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.414979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:01.425756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=942324db321044f1b4aaa666258d0943, user_id=8df8f357a09e4f678134d44d55ea3a3e, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.429134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.529470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 878/1779] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:01.531237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.556905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d328835-d6c7-482d-a82f-3828790d9fe6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.569287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.570662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.571101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.572796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] PATH_INFO: `/v3/projects/9c157f5d1fe2484a8771af67e05dd82f/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.586427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c157f5d1fe2484a8771af67e05dd82f, user_id=4baee8fe1ddf4c4c9cba6e46a5f1fb4f, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.589930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 902/1780] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:01 2022] PUT /identity/v3/projects/942324db321044f1b4aaa666258d0943/users/8df8f357a09e4f678134d44d55ea3a3e/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:01.594006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d215ed3-1a46-495a-96ad-516cf5011432 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.598367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.635652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 879/1781] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:01 2022] PUT /identity/v3/projects/9c157f5d1fe2484a8771af67e05dd82f/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:01.647440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.647763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.648165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.698704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] MFA Rules not processed for user `4baee8fe1ddf4c4c9cba6e46a5f1fb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:01.700127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:01.765411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84907b-e58b-4f9e-8eb6-15cacad05f9f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.871998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.872755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.873059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.873346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.874643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.880152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.892507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 903/1782] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:01.896876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.898833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:01.921120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 880/1783] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:01.921120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.941223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b4263-b5c7-41a6-b650-a285170c3949 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:01.948298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:01.949436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:01.949775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:01.950097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] PATH_INFO: `/v3/projects/942324db321044f1b4aaa666258d0943/users/8df8f357a09e4f678134d44d55ea3a3e/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:01.952755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942324db321044f1b4aaa666258d0943, user_id=8df8f357a09e4f678134d44d55ea3a3e, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:01.956061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:01.972293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 881/1784] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:01 2022] PUT /identity/v3/projects/942324db321044f1b4aaa666258d0943/users/8df8f357a09e4f678134d44d55ea3a3e/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:01.972293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:01.972293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:02.012204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb2189-0754-4755-96be-218a5642994c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:02.077349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60eedd-f7d1-4636-b07d-090409f912c3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:02.086779 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:02.087858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:02.088847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:02.089202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:02.089949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:02.097064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:02.139590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:02.141068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:02.141604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:02.142583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:02.155456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:02.158044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:02.191794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 904/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:02.314654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:02.320353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91888428-09ef-4835-b34c-c07e429ab88e service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:02.374614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 882/1786] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:02.395577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:02.397573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:02.420151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f350-ec00-49d3-a16a-a5f96fb69131 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:02.434480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2196-0120-4e7b-afc6-0cbfa41de64b None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:02.435081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2196-0120-4e7b-afc6-0cbfa41de64b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:02.436374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2196-0120-4e7b-afc6-0cbfa41de64b None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:02.438546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 883/1787] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:10:02.441633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:02.448213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:02.448213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:02.448213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:02.451903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:02.487725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:02.488011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:02.489062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:02.557882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:02.563283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:02.616529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 884/1788] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:10:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:02.811473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:02.813233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:02.844437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 905/1789] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:03.444309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:03.478082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8a594-d31b-4432-b07f-017ed8a669a4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:03.489996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:03.495074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:03.495074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:03.495074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:03.515362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:03.518897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:03.547382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 885/1790] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:04.238895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:04.238895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:04.382640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f69c78-676a-4712-9a2f-61717bf8acec service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:04.405709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:04.406888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:04.407243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:04.409103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] PATH_INFO: `/v3/projects/ccb9bce9fea34d4d87dffa44eb7d0dfd` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:04.411858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb9bce9fea34d4d87dffa44eb7d0dfd)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:04.414375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:04.733072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:04.740704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb9bce9fea34d4d87dffa44eb7d0dfd', 'request_id': 'req-3036167c-7f31-406c-98fd-b10996376d84'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:04.746551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb9bce9fea34d4d87dffa44eb7d0dfd', 'request_id': 'req-3036167c-7f31-406c-98fd-b10996376d84'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:04.816051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb9bce9fea34d4d87dffa44eb7d0dfd', 'request_id': 'req-3036167c-7f31-406c-98fd-b10996376d84'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:04.843795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] The token cache is being invalidate because project ccb9bce9fea34d4d87dffa44eb7d0dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:04.844159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:04.845050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:04.850292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 906/1791] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:04 2022] DELETE /identity/v3/projects/ccb9bce9fea34d4d87dffa44eb7d0dfd => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:04.851235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:04.869746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1635dd07-70d8-45d6-8a85-cd4726f50436 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:04.993871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:04.994957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:04.995432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:04.995907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] PATH_INFO: `/v3/users/0938560248ab4516bd3a6df179717fda` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:05.004641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0938560248ab4516bd3a6df179717fda)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:05.022017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:05.176561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:05.568954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0938560248ab4516bd3a6df179717fda'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:05.588161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0938560248ab4516bd3a6df179717fda'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:05.641945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0938560248ab4516bd3a6df179717fda'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:05.654926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0938560248ab4516bd3a6df179717fda'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:05.656007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0938560248ab4516bd3a6df179717fda'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:05.665317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 886/1792] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:04 2022] DELETE /identity/v3/users/0938560248ab4516bd3a6df179717fda => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:06.274126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:06.275843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:06.391036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3036167c-7f31-406c-98fd-b10996376d84 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:06.665802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:06.667096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:06.667589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:06.668402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:06.672061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:06.928464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:06.932499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627c61e-d183-4b77-8562-408641351960 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:06.964037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 907/1793] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:07.649170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:07.649170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:07.833089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9f35-7d7a-4880-9851-01c20d1eb598 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:07.838863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:07.839976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:07.840482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:07.840975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] PATH_INFO: `/v3/projects/04b224b5c6ad467aae124e644ee62896` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:07.842773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b224b5c6ad467aae124e644ee62896)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:07.845462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.033758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b224b5c6ad467aae124e644ee62896', 'request_id': 'req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:08.038394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909227f3-c275-4a25-8ce9-f5a9188dd4ca None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.039025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909227f3-c275-4a25-8ce9-f5a9188dd4ca None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.039123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909227f3-c275-4a25-8ce9-f5a9188dd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.046044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b224b5c6ad467aae124e644ee62896', 'request_id': 'req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:08.073661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:08.117698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-909227f3-c275-4a25-8ce9-f5a9188dd4ca None None] MFA Rules not processed for user `8df8f357a09e4f678134d44d55ea3a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:08.124565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-909227f3-c275-4a25-8ce9-f5a9188dd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:08.147147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b224b5c6ad467aae124e644ee62896', 'request_id': 'req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:08.163200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] The token cache is being invalidate because project 04b224b5c6ad467aae124e644ee62896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:08.163200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:08.163200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cffbe4a8-00df-4c8c-9855-f6aa0f808d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:08.163640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 887/1794] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:07 2022] DELETE /identity/v3/projects/04b224b5c6ad467aae124e644ee62896 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:08.167973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.168272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.168968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.197175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:08.198449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:08.246992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 908/1795] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:08.275994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 888/1796] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:08.283114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.283407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.283771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.309324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:08.310952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:08.320880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 909/1797] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:08.325742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.337637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64baec4-f3c4-406d-aa02-56b2f224b8bd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.342533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.343221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.343509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.343869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.344652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:08.345085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.346779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.359389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 889/1798] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:08.370461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.380288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a8827-cd9d-478d-99c0-9c4d7b107c7e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.386289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.387097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.387392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.387726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.388704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.396462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.450678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:08.490898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 910/1799] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:08.492114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.502845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53875763-19d8-4fa8-b37f-385c200ed336 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.570746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.574285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.574285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.574285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.574285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.576695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.675989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 890/1800] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/users => generated 283 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:08.688191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.701338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9d3cf-4abc-4366-8267-7e117f3d5be2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.705943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.706651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.706939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.707219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.707978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.709624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.721346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 911/1801] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:08.725514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.735528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab089f-782b-46a1-a208-e91e32efad3d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.740912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.741590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.741877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.742157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.742877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.748149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b090a-9f66-468c-a8e4-ee34d93d4749 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.763839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 891/1802] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:08.768068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:08.780034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526403f-78c1-4672-9e7b-a446f89151c0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:08.784951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:08.789263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.789263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.789263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] PATH_INFO: `/v3/projects/41a0113701ae4921ba927abc2c682f2f/users/25edd5afc5954737b7f61bedc49b995c/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.802640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a0113701ae4921ba927abc2c682f2f, user_id=25edd5afc5954737b7f61bedc49b995c, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:08.805367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:08.907789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 912/1803] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:08 2022] PUT /identity/v3/projects/41a0113701ae4921ba927abc2c682f2f/users/25edd5afc5954737b7f61bedc49b995c/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:08.913009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d6d4-03ae-4b98-b798-f6cd08d60491 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:08.913244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d6d4-03ae-4b98-b798-f6cd08d60491 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:08.913521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1d6d4-03ae-4b98-b798-f6cd08d60491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:08.940128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d9d1d6d4-03ae-4b98-b798-f6cd08d60491 None None] MFA Rules not processed for user `25edd5afc5954737b7f61bedc49b995c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:08.941365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d9d1d6d4-03ae-4b98-b798-f6cd08d60491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:09.011687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 892/1804] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:09.016704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.086058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9d14-c78c-4f2f-9e22-ca224d3e13cb None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.086452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9d14-c78c-4f2f-9e22-ca224d3e13cb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.086722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c9d14-c78c-4f2f-9e22-ca224d3e13cb None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.088988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 893/1805] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:10:09.107142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.107142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.107142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.115466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf30a6-e0f7-45ee-ade9-6f908340b239 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.129424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.130142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.130412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.130705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.131949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.133864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.149230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:09.150662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:09.230002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 894/1806] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:09.246528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.248290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:09.290281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:09.298239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 913/1807] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:09 2022] POST /identity/v3/projects => generated 369 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:09.298845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.301119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:09.326536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7b60e-8a1c-45a0-bbc4-8a37c5330aa1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.400148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.400916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.401303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.401647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.404602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:09.410846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9259207-f319-4bfa-8ae1-f2f0560c4a9d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.416818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.417572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.417869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.418151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.430363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.434565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.447892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 914/1808] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:09.448797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.490960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:09.503548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.505547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.516645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 895/1809] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:09.539626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62a5f8-fe5e-46e3-8c46-5b1611493335 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.541665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.542035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.542365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.542647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.543344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.545276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.679651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 915/1810] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:09 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:09.683774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.697765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448413a-e348-4423-bc42-cedffa850202 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.702590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.703665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.707619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.707619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.707619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.707619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.718123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 896/1811] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:09.722926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.733773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ce706-8949-4fa8-add6-faae6b0a964b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.739946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.740842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.741128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.741402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] PATH_INFO: `/v3/projects/8c0547f1407940d88a91d7153842cede/users/0b06433fc9ac4adcba94e1b3db95f220/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.763653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0547f1407940d88a91d7153842cede, user_id=0b06433fc9ac4adcba94e1b3db95f220, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.766612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.804341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:09.840236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 916/1812] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:09 2022] PUT /identity/v3/projects/8c0547f1407940d88a91d7153842cede/users/0b06433fc9ac4adcba94e1b3db95f220/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:09.844329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.854810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce28c-096f-4b78-bf97-d9f2975240d0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.913842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.914605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.914791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.915163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.916428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.918020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aba34c-7eaa-4653-8c48-122a7a14937a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.931911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 897/1813] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:09.933004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:09.951964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a7a2d-ff58-452e-964f-8a4dcc7d218e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:09.957602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:09.962815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.962815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.962815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] PATH_INFO: `/v3/projects/8c0547f1407940d88a91d7153842cede/users/0b06433fc9ac4adcba94e1b3db95f220/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:09.962815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0547f1407940d88a91d7153842cede, user_id=0b06433fc9ac4adcba94e1b3db95f220, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:09.963962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549bc1f4-44d4-4e6e-a4c2-ae79f0aa374a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:09.975763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 917/1814] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:09 2022] PUT /identity/v3/projects/8c0547f1407940d88a91d7153842cede/users/0b06433fc9ac4adcba94e1b3db95f220/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:09.986847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:09.993154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:09.993154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.023134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] MFA Rules not processed for user `0b06433fc9ac4adcba94e1b3db95f220`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:10.024629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:10.059911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52eda-b61a-4002-88cb-6aafaa8b045b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.066788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52eda-b61a-4002-88cb-6aafaa8b045b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.066788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae52eda-b61a-4002-88cb-6aafaa8b045b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.066788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 918/1815] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:10:10.075544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.075968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.076349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.114668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] MFA Rules not processed for user `df158bb2f58b492d825a7b77ff35d9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:10.117150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:10.173303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 898/1816] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:10.189287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:10.255239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 919/1817] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:10:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:10.271751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edf37b-1524-4c85-a66f-f74940079f4d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:10.273894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:10.283234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:10.284117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.288198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33054b9f-2d0e-4293-be28-17cd5048d246 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:10.289140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.290382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.298554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:10.299681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.300144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.301312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.312598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:10.313397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:10.315263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:10.315374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:10.328202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 920/1818] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:10.335097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 899/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:10.384336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:10.386233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:10.509218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:10.509218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:10.522003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be6e67-d203-44c5-86ce-10ea6fcc67d9 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:10.527237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b6817-dffa-412a-b9f3-67826f2865f5 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:10.537338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:10.539176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:10.539306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.539306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.539479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:10.539601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.539686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:10.539686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] PATH_INFO: `/v3/users/8cee16023ea5413b9b775cebaa0e9174` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:10.540586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cee16023ea5413b9b775cebaa0e9174)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:10.543355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:10.573996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:10.614245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:10.615735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:10.625085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 900/1820] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:10.731977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cee16023ea5413b9b775cebaa0e9174'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:10.732767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cee16023ea5413b9b775cebaa0e9174'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:10.733466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cee16023ea5413b9b775cebaa0e9174'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:10.740798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cee16023ea5413b9b775cebaa0e9174'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:10.752538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cee16023ea5413b9b775cebaa0e9174'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:10.843714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 921/1821] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:10 2022] DELETE /identity/v3/users/8cee16023ea5413b9b775cebaa0e9174 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:11.010632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:11.167394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:11.179530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d174c-c5df-4650-8e0e-0cccd2d2fe24 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:11.242832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:11.243887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:11.244289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:11.244748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] PATH_INFO: `/v3/projects/4572bc6ffa8b461592062fc8a2ac735c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:11.246062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4572bc6ffa8b461592062fc8a2ac735c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:11.251154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:11.369978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4572bc6ffa8b461592062fc8a2ac735c', 'request_id': 'req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.375762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4572bc6ffa8b461592062fc8a2ac735c', 'request_id': 'req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.455128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4572bc6ffa8b461592062fc8a2ac735c', 'request_id': 'req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.469437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] The token cache is being invalidate because project 4572bc6ffa8b461592062fc8a2ac735c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:11.470045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.470887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.476122 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 901/1822] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:11 2022] DELETE /identity/v3/projects/4572bc6ffa8b461592062fc8a2ac735c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:11.478025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:11.479766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:11.497453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e9166-cab0-4010-ae38-8fd4b7a93618 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:11.563800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:11.564908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:11.565360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:11.565738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] PATH_INFO: `/v3/users/8df8f357a09e4f678134d44d55ea3a3e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:11.567485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df8f357a09e4f678134d44d55ea3a3e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:11.569851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:11.781739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df8f357a09e4f678134d44d55ea3a3e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.782511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df8f357a09e4f678134d44d55ea3a3e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.783177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df8f357a09e4f678134d44d55ea3a3e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.791236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df8f357a09e4f678134d44d55ea3a3e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.802992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6a3b9533-6d5c-40a3-9adb-0172d4b8ae05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df8f357a09e4f678134d44d55ea3a3e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:11.883228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 922/1823] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:11 2022] DELETE /identity/v3/users/8df8f357a09e4f678134d44d55ea3a3e => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:11.969190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:12.144169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.145675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:12.159144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca8c5-4ea4-4653-bee2-c6eb5c7f02f7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.218751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.220274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.220642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.220964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] PATH_INFO: `/v3/projects/942324db321044f1b4aaa666258d0943` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.222755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=942324db321044f1b4aaa666258d0943)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.224762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.330736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942324db321044f1b4aaa666258d0943', 'request_id': 'req-f37b3357-e503-4dbc-b836-4ca3b287d39f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:12.337057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942324db321044f1b4aaa666258d0943', 'request_id': 'req-f37b3357-e503-4dbc-b836-4ca3b287d39f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:12.409311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942324db321044f1b4aaa666258d0943', 'request_id': 'req-f37b3357-e503-4dbc-b836-4ca3b287d39f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:12.422861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] The token cache is being invalidate because project 942324db321044f1b4aaa666258d0943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:12.423016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:12.423684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f37b3357-e503-4dbc-b836-4ca3b287d39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:12.425276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 902/1824] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:12 2022] DELETE /identity/v3/projects/942324db321044f1b4aaa666258d0943 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:12.430832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.431129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.431415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.452325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:12.453529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:12.521530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 923/1825] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:12.523031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c975-0ab5-4861-a582-23228738b52d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.523329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c975-0ab5-4861-a582-23228738b52d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.523693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069c975-0ab5-4861-a582-23228738b52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.544381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5069c975-0ab5-4861-a582-23228738b52d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:12.545779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5069c975-0ab5-4861-a582-23228738b52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:12.553909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 903/1826] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:12.558238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.568302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04411d9-088d-49c1-877f-3a41f20455d3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.573456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.574134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.574449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.574727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.575474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:12.575824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.577549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.592160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 924/1827] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:12.598876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c975-0ab5-4861-a582-23228738b52d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.609027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069c975-0ab5-4861-a582-23228738b52d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.613895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.614579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.614868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.615287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.616032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.618010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.701098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 904/1828] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:12 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:12.706242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.716981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f4608-aa41-49fc-9cab-5753a355e85c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.783789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.784707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.785062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.785406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.786277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.788316 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.903337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 925/1829] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:12 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:12.913442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.928742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab273d-08d9-4899-9f37-29c48381628b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.935755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.936881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.937451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.937938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.938993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.941290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.953550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 905/1830] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:12.958366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:12.970230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414642c8-529c-4862-8117-76e3b72177c3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:12.975155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:12.975863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:12.976154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:12.976438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:12.977168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:12.978778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980154f-f180-4643-94bb-2352fa599f01 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:12.994185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 926/1831] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:12.995681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.006794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1292b60-81b0-412b-b743-5889e89b6e25 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.011610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.012565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.012854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.013391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] PATH_INFO: `/v3/projects/e7d2b3a20a314cecb9bb9eef803cccaf/users/44250b3ae6544df3bf584d63f64f1f83/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.035651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7d2b3a20a314cecb9bb9eef803cccaf, user_id=44250b3ae6544df3bf584d63f64f1f83, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.038944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.141809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 906/1832] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:12 2022] PUT /identity/v3/projects/e7d2b3a20a314cecb9bb9eef803cccaf/users/44250b3ae6544df3bf584d63f64f1f83/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:13.154004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.154321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.154601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.181292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] MFA Rules not processed for user `44250b3ae6544df3bf584d63f64f1f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:13.182506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:13.228148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:13.254071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 927/1833] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:13.257408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.318994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b58e76-faf6-4c3b-a0ee-229a35f7bd71 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.323763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.324428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.324714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.325018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.325702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.327613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.438607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 907/1834] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:13 2022] POST /identity/v3/projects => generated 365 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:13.444261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.455861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a703ef6-09e0-418c-8465-3adb9a860dde None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.460960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:13.518823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.520073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.520461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.520845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.521626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.523598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.630030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 928/1835] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:13 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:13.631287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.641836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94edd0c-9a77-4471-bced-c07e6d3d6527 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.646639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.647306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.647700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.648165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.649087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.650683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.661959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 908/1836] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:13.666193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.677315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcc380-08ea-4f4d-a203-c39e0e3bcfb6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.681817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.682691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.683006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.683284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] PATH_INFO: `/v3/projects/fd34838678ac4358abb3bb37a1cacf94/users/5b0b3e7585b44152b667483f72e8ff5f/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.699965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd34838678ac4358abb3bb37a1cacf94, user_id=5b0b3e7585b44152b667483f72e8ff5f, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.702604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.804409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 929/1837] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:13 2022] PUT /identity/v3/projects/fd34838678ac4358abb3bb37a1cacf94/users/5b0b3e7585b44152b667483f72e8ff5f/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:13.808487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.819362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad645e-0852-46e5-b63b-187ff8f792c4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.875790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.876490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.876774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.877053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.877770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.879590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af567bb7-ea9a-4038-85ab-2df7657c8cc5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.890053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 909/1838] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:13.895004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:13.905353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa320d4-a201-44a2-a8fe-ec3864cf4ad6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:13.910772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:13.912007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.912364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.912569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] PATH_INFO: `/v3/projects/fd34838678ac4358abb3bb37a1cacf94/users/5b0b3e7585b44152b667483f72e8ff5f/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.917496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd34838678ac4358abb3bb37a1cacf94, user_id=5b0b3e7585b44152b667483f72e8ff5f, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:13.917496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:13.932493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 930/1839] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:13 2022] PUT /identity/v3/projects/fd34838678ac4358abb3bb37a1cacf94/users/5b0b3e7585b44152b667483f72e8ff5f/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:13.943516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:13.944083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:13.944520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:13.979976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] MFA Rules not processed for user `5b0b3e7585b44152b667483f72e8ff5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:13.979976 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:14.071084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 910/1840] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:14.083907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:14.085878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:14.160277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041851e0-a77f-429f-a602-47378f98113c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:14.164160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:14.164818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:14.165233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:14.165522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:14.177970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:14.180021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:14.190246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 931/1841] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:15.177227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:15.427107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:15.736141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:15.737771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:15.804329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ed7f8-bfa6-44ea-bf9c-3450e0c327e4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:15.809288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:15.810201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:15.813130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:15.813130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] PATH_INFO: `/v3/users/39b877c33f114e6992f4f68ae98858bc` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:15.813130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b877c33f114e6992f4f68ae98858bc)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:15.813918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:15.992561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:16.030679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:16.042187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa4897-a19a-4019-aa09-51f28ac10707 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:16.048629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:16.049678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.049958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.050233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] PATH_INFO: `/v3/users/44250b3ae6544df3bf584d63f64f1f83` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.051590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44250b3ae6544df3bf584d63f64f1f83)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:16.052717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b877c33f114e6992f4f68ae98858bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.053656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:16.064838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b877c33f114e6992f4f68ae98858bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.162829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b877c33f114e6992f4f68ae98858bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.172587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b877c33f114e6992f4f68ae98858bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.172587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-20b44bd5-9860-4e9b-801b-15424a8c71f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b877c33f114e6992f4f68ae98858bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.178316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 911/1842] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:15 2022] DELETE /identity/v3/users/39b877c33f114e6992f4f68ae98858bc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:16.182709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.182996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.183301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.202260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:16.203474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.261720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 912/1843] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:16.269483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44250b3ae6544df3bf584d63f64f1f83'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.270262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44250b3ae6544df3bf584d63f64f1f83'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.270973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44250b3ae6544df3bf584d63f64f1f83'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.272322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:16.273704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.278281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44250b3ae6544df3bf584d63f64f1f83'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.291826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-effafbac-35e1-425f-b49f-81678f277d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44250b3ae6544df3bf584d63f64f1f83'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.329307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8da85d-d4e7-459f-a118-d3f1e9a2d6ed None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:16.333590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:16.334262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.334543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.334816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.336675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.349275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:16.350770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:16.366418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 913/1844] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:16.381945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:16.385666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.387062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 932/1845] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:16 2022] DELETE /identity/v3/users/44250b3ae6544df3bf584d63f64f1f83 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:16.388968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.389272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.389561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.415630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aaaa-fe72-448d-b9fa-ff654b1bdf98 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:16.431305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:16.437695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.563141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:16.565975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.566406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.567339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] PATH_INFO: `/v3/users/25edd5afc5954737b7f61bedc49b995c` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.571593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25edd5afc5954737b7f61bedc49b995c)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:16.587013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:16.587120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 933/1846] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:16.598719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:16.601759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:16.683446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44af5-85d1-4d6f-b41b-198d0cb7a848 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:16.687697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:16.688370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:16.688658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:16.688941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:16.699719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:16.701390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60648f7-1e53-45ab-9f42-504a840e76a6 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:16.713604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 934/1847] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:16.853292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25edd5afc5954737b7f61bedc49b995c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.878663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25edd5afc5954737b7f61bedc49b995c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.981196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25edd5afc5954737b7f61bedc49b995c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.993096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25edd5afc5954737b7f61bedc49b995c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:16.993864 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-71e94c61-8920-4cae-a05e-9bfb7b1a37c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25edd5afc5954737b7f61bedc49b995c'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.018707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 914/1848] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:16 2022] DELETE /identity/v3/users/25edd5afc5954737b7f61bedc49b995c => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:17.020725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.021021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.021306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.048626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:17.048772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:17.049860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.108753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad01-f9f9-416f-a4fb-a6a1f3a9dabe None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.108753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad01-f9f9-416f-a4fb-a6a1f3a9dabe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.108753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad01-f9f9-416f-a4fb-a6a1f3a9dabe None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.110725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 915/1849] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:10:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:10:17.125027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.125322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.125603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.156300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:17.157558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.174616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 935/1850] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:17.183289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.186956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.210843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc66045f-2cae-44ff-b11e-c37f607a819a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:17.232570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:17.233471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.233760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.234042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] PATH_INFO: `/v3/projects/a897fca373594c2da77493e1e50802ad` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.235474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a897fca373594c2da77493e1e50802ad)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:17.241879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:17.273737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 916/1851] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:10:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:17.275893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.277475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.359746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68d595c-2053-45e8-a368-9d9cb065a259 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:17.361510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:17.362291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.363215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.363596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.373840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:17.375302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:17.387660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 917/1852] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:17.389196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.390172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.405719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a897fca373594c2da77493e1e50802ad', 'request_id': 'req-744e4082-97b3-4f36-ac6e-f43068ad99b8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.411305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd45a6-4223-4b94-b69f-7d0f40ed4106 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:17.416201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a897fca373594c2da77493e1e50802ad', 'request_id': 'req-744e4082-97b3-4f36-ac6e-f43068ad99b8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.483912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a897fca373594c2da77493e1e50802ad', 'request_id': 'req-744e4082-97b3-4f36-ac6e-f43068ad99b8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.489794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:17.490721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.495430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.495430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.500643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] The token cache is being invalidate because project a897fca373594c2da77493e1e50802ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:17.500937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.501888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.503628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 936/1853] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:17 2022] DELETE /identity/v3/projects/a897fca373594c2da77493e1e50802ad => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:17.504535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.506100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.507214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:17.512186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:17.531608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 918/1854] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:17.542128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.586868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744e4082-97b3-4f36-ac6e-f43068ad99b8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:17.594587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:17.595989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.598778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.598778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] PATH_INFO: `/v3/projects/e7d2b3a20a314cecb9bb9eef803cccaf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.599043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7d2b3a20a314cecb9bb9eef803cccaf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:17.601948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:17.628153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57636dc5-62f0-48dd-95a5-3f18652de57d service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:17.639939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:17.642313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:17.642313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:17.642593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] PATH_INFO: `/v3/users/b1a5a5cc51454c1dbc60113f914e6c48` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:17.644882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1a5a5cc51454c1dbc60113f914e6c48)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:17.647697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:17.742783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7d2b3a20a314cecb9bb9eef803cccaf', 'request_id': 'req-0f4a7d25-bf85-49a6-b642-737a7947011b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.749756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7d2b3a20a314cecb9bb9eef803cccaf', 'request_id': 'req-0f4a7d25-bf85-49a6-b642-737a7947011b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.818556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1a5a5cc51454c1dbc60113f914e6c48'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.831213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1a5a5cc51454c1dbc60113f914e6c48'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.833442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7d2b3a20a314cecb9bb9eef803cccaf', 'request_id': 'req-0f4a7d25-bf85-49a6-b642-737a7947011b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.846780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] The token cache is being invalidate because project e7d2b3a20a314cecb9bb9eef803cccaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:17.847172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.848208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.850359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 937/1855] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:17 2022] DELETE /identity/v3/projects/e7d2b3a20a314cecb9bb9eef803cccaf => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:17.855527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:17.856254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:17.912347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1a5a5cc51454c1dbc60113f914e6c48'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.924627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1a5a5cc51454c1dbc60113f914e6c48'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.925698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1a5a5cc51454c1dbc60113f914e6c48'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:17.936526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 919/1856] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:17 2022] DELETE /identity/v3/users/b1a5a5cc51454c1dbc60113f914e6c48 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:17.943518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a7d25-bf85-49a6-b642-737a7947011b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:18.011163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.037259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:18.038500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:18.038839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:18.039191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] PATH_INFO: `/v3/users/5b0b3e7585b44152b667483f72e8ff5f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:18.049681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0b3e7585b44152b667483f72e8ff5f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:18.056061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:18.170443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:18.171910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:18.188935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f69f2b-0ce8-4b71-a945-a9d07c7862d9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:18.198693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:18.198693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:18.198693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:18.198693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] PATH_INFO: `/v3/projects/41a0113701ae4921ba927abc2c682f2f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:18.199276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a0113701ae4921ba927abc2c682f2f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:18.199761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:18.321958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a0113701ae4921ba927abc2c682f2f', 'request_id': 'req-416773f0-f357-43bb-99e3-125474fd5064'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.328365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a0113701ae4921ba927abc2c682f2f', 'request_id': 'req-416773f0-f357-43bb-99e3-125474fd5064'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.336382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0b3e7585b44152b667483f72e8ff5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.339729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0b3e7585b44152b667483f72e8ff5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.340392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0b3e7585b44152b667483f72e8ff5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.348410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0b3e7585b44152b667483f72e8ff5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.360729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0b3e7585b44152b667483f72e8ff5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.404476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a0113701ae4921ba927abc2c682f2f', 'request_id': 'req-416773f0-f357-43bb-99e3-125474fd5064'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.417788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] The token cache is being invalidate because project 41a0113701ae4921ba927abc2c682f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:18.418089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.418956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.420918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 920/1857] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:18 2022] DELETE /identity/v3/projects/41a0113701ae4921ba927abc2c682f2f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:18.424793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:18.428696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:18.494905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 938/1858] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:17 2022] DELETE /identity/v3/users/5b0b3e7585b44152b667483f72e8ff5f => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:18.496842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:18.499726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:18.520523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416773f0-f357-43bb-99e3-125474fd5064 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:18.626929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:18.655408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cae267-b015-49ad-be8a-e1bf6240f6c0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:18.656090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:18.657726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:18.658736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:18.659189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] PATH_INFO: `/v3/users/0b06433fc9ac4adcba94e1b3db95f220` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:18.661893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b06433fc9ac4adcba94e1b3db95f220)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:18.662787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:18.664361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:18.664769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:18.665215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:18.665412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] PATH_INFO: `/v3/projects/ac2e6b8da5904261bfbf0b684e5794bb` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:18.667115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2e6b8da5904261bfbf0b684e5794bb)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:18.670346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:18.922112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b06433fc9ac4adcba94e1b3db95f220'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.922668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2e6b8da5904261bfbf0b684e5794bb', 'request_id': 'req-44bbb043-d15e-4a83-8372-e04a58e13acd'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.935960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2e6b8da5904261bfbf0b684e5794bb', 'request_id': 'req-44bbb043-d15e-4a83-8372-e04a58e13acd'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:18.959741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b06433fc9ac4adcba94e1b3db95f220'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.044319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:19.060795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2e6b8da5904261bfbf0b684e5794bb', 'request_id': 'req-44bbb043-d15e-4a83-8372-e04a58e13acd'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.082873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] The token cache is being invalidate because project ac2e6b8da5904261bfbf0b684e5794bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:19.083183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.084042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.085937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 939/1859] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:18 2022] DELETE /identity/v3/projects/ac2e6b8da5904261bfbf0b684e5794bb => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:19.089252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:19.091687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:19.114773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b06433fc9ac4adcba94e1b3db95f220'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.124220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b06433fc9ac4adcba94e1b3db95f220'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.125394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b06433fc9ac4adcba94e1b3db95f220'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.134095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 921/1860] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:18 2022] DELETE /identity/v3/users/0b06433fc9ac4adcba94e1b3db95f220 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:19.135193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:19.144681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:19.189532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbb043-d15e-4a83-8372-e04a58e13acd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:19.277052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6db9ce-e244-4a39-9abd-15080e2ae00a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:19.280171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:19.281430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.281635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.282095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] PATH_INFO: `/v3/projects/fd34838678ac4358abb3bb37a1cacf94` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.283246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd34838678ac4358abb3bb37a1cacf94)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:19.285737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:19.286049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:19.287420 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.287967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.288311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] PATH_INFO: `/v3/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.290268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4baee8fe1ddf4c4c9cba6e46a5f1fb4f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:19.292257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:19.561896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4baee8fe1ddf4c4c9cba6e46a5f1fb4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.562532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd34838678ac4358abb3bb37a1cacf94', 'request_id': 'req-c196de31-5452-4838-af26-0e8332ff3b10'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.568957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd34838678ac4358abb3bb37a1cacf94', 'request_id': 'req-c196de31-5452-4838-af26-0e8332ff3b10'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.575867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4baee8fe1ddf4c4c9cba6e46a5f1fb4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.643824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd34838678ac4358abb3bb37a1cacf94', 'request_id': 'req-c196de31-5452-4838-af26-0e8332ff3b10'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.656239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] The token cache is being invalidate because project fd34838678ac4358abb3bb37a1cacf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:19.656479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.657182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.658947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 940/1861] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:19 2022] DELETE /identity/v3/projects/fd34838678ac4358abb3bb37a1cacf94 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:19.660530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:19.661860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:19.725410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196de31-5452-4838-af26-0e8332ff3b10 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:19.730158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:19.731070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.731357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.731666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] PATH_INFO: `/v3/projects/8c0547f1407940d88a91d7153842cede` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.732902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0547f1407940d88a91d7153842cede)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:19.734897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:19.746392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4baee8fe1ddf4c4c9cba6e46a5f1fb4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.753839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4baee8fe1ddf4c4c9cba6e46a5f1fb4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.754492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ab895869-3087-4938-8bba-3c2cde99c703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4baee8fe1ddf4c4c9cba6e46a5f1fb4f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.760409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 922/1862] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:19 2022] DELETE /identity/v3/users/4baee8fe1ddf4c4c9cba6e46a5f1fb4f => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:19.763903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4a662-32dd-4808-b018-faf10bfb8050 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.763903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4a662-32dd-4808-b018-faf10bfb8050 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.763903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4a662-32dd-4808-b018-faf10bfb8050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.784089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f9d4a662-32dd-4808-b018-faf10bfb8050 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:19.786197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f9d4a662-32dd-4808-b018-faf10bfb8050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:19.860913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0547f1407940d88a91d7153842cede', 'request_id': 'req-fa320acc-4726-4ca3-8e75-148869c1c07d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.861817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 923/1863] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:19.869746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.870170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.870489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.873733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0547f1407940d88a91d7153842cede', 'request_id': 'req-fa320acc-4726-4ca3-8e75-148869c1c07d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.889313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:19.890563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:19.964856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 924/1864] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:19.968919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:19.974257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0547f1407940d88a91d7153842cede', 'request_id': 'req-fa320acc-4726-4ca3-8e75-148869c1c07d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.979901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193497b-04bc-4d1e-921c-b7abf1b55bc4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:19.984906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:19.985574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:19.985862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:19.986151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:19.986893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:19.987304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:19.989525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:19.990019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] The token cache is being invalidate because project 8c0547f1407940d88a91d7153842cede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:19.990527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.991670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fa320acc-4726-4ca3-8e75-148869c1c07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:19.994154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 941/1865] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:19 2022] DELETE /identity/v3/projects/8c0547f1407940d88a91d7153842cede => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:20.000663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1e34-8173-4aa0-a31c-2176e2294f90 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.001179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1e34-8173-4aa0-a31c-2176e2294f90 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.001768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171e1e34-8173-4aa0-a31c-2176e2294f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.003289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 925/1866] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:10:20.007345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.013611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.033662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-171e1e34-8173-4aa0-a31c-2176e2294f90 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.033662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-171e1e34-8173-4aa0-a31c-2176e2294f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.033853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcec36-fe19-4bdc-9530-9a2e25b2f7df admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.039877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.040556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.041020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.041460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.042305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.044510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.052376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 942/1867] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:20.054728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.055131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.056809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.077711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.078589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.088976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 943/1868] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:20.093156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.102961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c1350-9bf4-4397-a258-a5c3c49244d9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.108339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.108963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.109259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.109539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.110277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:20.110590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.112238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.126872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 944/1869] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:10:20.132471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.146179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dc5d6-0755-4431-ac8e-35db752cc61c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.151434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.155727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.155727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.155727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.155727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.156589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.166161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 926/1870] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:20.168356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.234895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:20.236981 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba156e-330b-443f-870c-4ad77b8a8bc6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.242537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.243243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.243527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.243840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.244526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.246455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.271160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 945/1871] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:20.272044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.273298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:20.273789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.346066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d172e-e133-454c-959f-469a64382686 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.348921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 927/1872] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:20.349816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.355287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.356506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.357186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.357537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] PATH_INFO: `/v3/projects/9c157f5d1fe2484a8771af67e05dd82f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.358963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c157f5d1fe2484a8771af67e05dd82f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.360446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab404da-418b-437a-ae3b-0287d121c14e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.360968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.367346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.368108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.368453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.368737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.369449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.371370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.519118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 928/1873] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:20.520066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.530632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca1ac-70bb-4b95-b811-8c9859e58845 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.534054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c157f5d1fe2484a8771af67e05dd82f', 'request_id': 'req-c37c8211-09df-45bf-8f27-55328ab179e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:20.540115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c157f5d1fe2484a8771af67e05dd82f', 'request_id': 'req-c37c8211-09df-45bf-8f27-55328ab179e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:20.592218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.592912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.593225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.593508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.594240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.595884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.608314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 929/1874] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:20.610419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.624984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424196d2-5ceb-4ecf-a6d1-669e12df9fdc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.629977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.630987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.631834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.632119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.632558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c157f5d1fe2484a8771af67e05dd82f', 'request_id': 'req-c37c8211-09df-45bf-8f27-55328ab179e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:20.633013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.634447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.646143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 930/1875] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:20.646491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] The token cache is being invalidate because project 9c157f5d1fe2484a8771af67e05dd82f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:20.646846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.646952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:20.647671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:20.652668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 946/1876] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:20 2022] DELETE /identity/v3/projects/9c157f5d1fe2484a8771af67e05dd82f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:20.652668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.654520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.657001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeae3a9-780d-4a3c-9c3a-c90d8d5f333f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.662749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.663603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.663935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.664159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.665188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.666491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba6914-0d2a-4996-a0b1-4cdeeb45cb10 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.670249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c8211-09df-45bf-8f27-55328ab179e9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.676117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.676912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.677665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.677665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.678408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.678656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 931/1877] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:20.680115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.683290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.683756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.684039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.692082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 947/1878] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:20.692799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.696890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.703588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.704831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.711811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474f08-acd3-4f40-bb6c-34ba47d4766a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.713809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 932/1879] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:20.714596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.725695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.726646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.726935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.727217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] PATH_INFO: `/v3/projects/5508b8e1aea94735b2bbd25f9de8bb5f/users/3cafecfc9b004534a3b4bd1cb1c60116/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.728164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e997d-d059-4b97-a402-2a08ffe25dab None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:20.733777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:20.734681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.734970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.735252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] PATH_INFO: `/v3/projects/7f75cb74f6d546199b8b2be5dbe95815/users/656925cce20d4fb2b7e207ec51e8f068/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.744117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5508b8e1aea94735b2bbd25f9de8bb5f, user_id=3cafecfc9b004534a3b4bd1cb1c60116, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.747157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3bd9a-401d-4d36-affe-223a60ccec87 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.753724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f75cb74f6d546199b8b2be5dbe95815, user_id=656925cce20d4fb2b7e207ec51e8f068, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:20.756484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24242b5-0dbb-4548-b1bf-a0d97c2946ad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:20.836901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 948/1880] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:20 2022] PUT /identity/v3/projects/5508b8e1aea94735b2bbd25f9de8bb5f/users/3cafecfc9b004534a3b4bd1cb1c60116/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:20.836901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285547-b81d-43ec-8d0e-3f8e0490b3c8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.836901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285547-b81d-43ec-8d0e-3f8e0490b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.836901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15285547-b81d-43ec-8d0e-3f8e0490b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.846808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15285547-b81d-43ec-8d0e-3f8e0490b3c8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.848369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15285547-b81d-43ec-8d0e-3f8e0490b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.851648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:20.857592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 933/1881] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:20 2022] PUT /identity/v3/projects/7f75cb74f6d546199b8b2be5dbe95815/users/656925cce20d4fb2b7e207ec51e8f068/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:20.868214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.868509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.868783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.905154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] MFA Rules not processed for user `3cafecfc9b004534a3b4bd1cb1c60116`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.906307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.921230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 949/1882] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:20.921230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:20.921230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:20.921230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:20.948358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] MFA Rules not processed for user `656925cce20d4fb2b7e207ec51e8f068`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:20.949655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:20.978960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 934/1883] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:20.979582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:20.994562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45074992-b9f4-4728-9a4a-f4aeacc4c8cf None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.002655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.004060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.004412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.005199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.006534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:21.006850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.008977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.026308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 935/1884] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:21.027444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.042092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471965c-e1ff-407e-a600-6b2ffd9bbd45 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.051084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 950/1885] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:21.052322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.052450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.053126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.053409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.053692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.054391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.056529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.066725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac51a66-9075-4e37-ab11-00d756fe8d07 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.073178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.074106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.075665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.075665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.076274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.079251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.162513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 936/1886] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.163335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.183500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 951/1887] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.184890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.232372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274a42-59bf-44cb-be7e-b9384f9ccd75 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.253637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadfeea-9f54-431c-8a69-efbb62085fdd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.258909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.259634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.259905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.260218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.261044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.263712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.296812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:21.299462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.300431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.300869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.301223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.302106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.304152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.388071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 952/1888] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.388071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.398523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88f2e7-8986-477e-b867-6fec99b5b23d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.404419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.405097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.405402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.405664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.406861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.408840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.412799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 937/1889] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/projects => generated 389 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.412799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.414312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:21.482378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06367004-da18-47d0-9d44-168950b492e3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.491847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.492990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.493561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.494013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] PATH_INFO: `/v3/users/05fb1960b5d24d81b585b4bf5818e8b3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.495689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fb1960b5d24d81b585b4bf5818e8b3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.498482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.501338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 953/1890] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.502463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.516230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea85f13-7edd-4345-86b2-4f8f01e2c1ef admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.523002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.524019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.524798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.525272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.526181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.528281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.541355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 954/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:21.542508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.554851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3233c-8309-4e66-b80b-603059826989 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.559979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.561156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.561156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.561364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.561887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.563896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.668025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 955/1892] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:21.669951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.672747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:21.682903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3931482-f15d-4d90-bf46-e7daeb2ab6a3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.686729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fb1960b5d24d81b585b4bf5818e8b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:21.687636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.688300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.688586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.689572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.689756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.692083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.699837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fb1960b5d24d81b585b4bf5818e8b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:21.705926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 956/1893] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:21.707383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.717186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d16fe-9666-4949-9a40-b9f68fc0184b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.722716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.723282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.723585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.723891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] PATH_INFO: `/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f/users/c217cc0d2c3e4211ae99c1020ecc3f46/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.741737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299c8e2ed5f64ede81437ca33a25fd1f, user_id=c217cc0d2c3e4211ae99c1020ecc3f46, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.744442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.779319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fb1960b5d24d81b585b4bf5818e8b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:21.786884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fb1960b5d24d81b585b4bf5818e8b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:21.787670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fb1960b5d24d81b585b4bf5818e8b3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:21.793639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 938/1894] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:21 2022] DELETE /identity/v3/users/05fb1960b5d24d81b585b4bf5818e8b3 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:21.794449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.795812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:21.814743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 957/1895] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:21 2022] PUT /identity/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f/users/c217cc0d2c3e4211ae99c1020ecc3f46/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:21.816573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.818844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:21.864254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2873e4-6ab9-4de0-bfc5-4b5bd8bd22b7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.889150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c134d-4425-4ad9-91e3-6fb5f58f22e9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.896565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.897331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.897749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.898101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.898914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.900652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffd987-3304-4adc-9bb4-ea0e53aa0897 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.931099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 958/1896] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:21.931099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.931099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.931099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.931893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.932587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.932871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.933161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.933462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:21.933894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.934687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:21.935508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.944009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 959/1897] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:21.944815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.946068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:21.949525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 939/1898] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:21.949525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.959289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafcff-c925-4d27-893d-096e6e6b6c4d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.962451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902fa975-2833-4d64-b5f0-ae4dd3e9a354 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.965488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.965488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.965488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.965488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.966142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.967785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.969918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.971111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.971546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:21.972657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] PATH_INFO: `/v3/projects/d3f7cbc2eccd4208ae68458523045375/users/54a1b0e9e3164d7c91fb973c11a0a515/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:21.981756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 960/1899] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:21.981756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:21.989656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e732b224-fa19-4708-b0eb-34105971cb72 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:21.992193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f7cbc2eccd4208ae68458523045375, user_id=54a1b0e9e3164d7c91fb973c11a0a515, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:21.994516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:21.995050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:21.995400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:21.995718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.045245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] PATH_INFO: `/v3/projects/db31923ed74b41a6888946787acfe22d/users/2c5dcb2daada44b7b363e043a64b3827/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.045245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db31923ed74b41a6888946787acfe22d, user_id=2c5dcb2daada44b7b363e043a64b3827, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.045245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.106276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 940/1900] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:21 2022] PUT /identity/v3/projects/d3f7cbc2eccd4208ae68458523045375/users/54a1b0e9e3164d7c91fb973c11a0a515/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:22.107111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.108677 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.139478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 961/1901] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:21 2022] PUT /identity/v3/projects/db31923ed74b41a6888946787acfe22d/users/2c5dcb2daada44b7b363e043a64b3827/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:22.140259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.175136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc7b53-5096-49e4-af7b-d31a2b6dc9f3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.211213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cd83-02b4-442b-a71f-fbecaa230710 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.216078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.216975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.217262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.217539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] PATH_INFO: `/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f/users/c217cc0d2c3e4211ae99c1020ecc3f46/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.219788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=299c8e2ed5f64ede81437ca33a25fd1f, user_id=c217cc0d2c3e4211ae99c1020ecc3f46, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.222499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948679d0-52ff-4c87-b551-7bcf6bfc79a0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.230051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.230878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.231258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.231666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.233516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 962/1902] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:22 2022] PUT /identity/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f/users/c217cc0d2c3e4211ae99c1020ecc3f46/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:22.242524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212f7bf-b9fb-4916-b333-bc3b754e32f2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.242870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.243652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212f7bf-b9fb-4916-b333-bc3b754e32f2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.244173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212f7bf-b9fb-4916-b333-bc3b754e32f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.244581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.256580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 941/1903] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:22.264935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.288219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311a9cc-b2e3-4d0a-a6f8-e69d0ded91ed service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.291758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b212f7bf-b9fb-4916-b333-bc3b754e32f2 None None] MFA Rules not processed for user `54a1b0e9e3164d7c91fb973c11a0a515`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:22.294010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b212f7bf-b9fb-4916-b333-bc3b754e32f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.405072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 963/1904] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:22.405072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.419128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.420858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.426846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.427549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.427851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.428126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.428857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.430484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.457188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 942/1905] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:22.458109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.463064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.482629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] MFA Rules not processed for user `c217cc0d2c3e4211ae99c1020ecc3f46`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:22.485945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.587983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:22.591999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fedff1-2cc4-452e-87ae-6a04faebed74 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.596844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.598164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.598450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.598910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.612394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 964/1906] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:22.614231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.631977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.633428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.646208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 943/1907] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:22 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:22.647064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:22.648618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.663666 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae915a-6778-47a4-9a17-c8334144fd34 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.687223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.688621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.688621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.688804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] PATH_INFO: `/v3/projects/db31923ed74b41a6888946787acfe22d/users/2c5dcb2daada44b7b363e043a64b3827/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.692588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=db31923ed74b41a6888946787acfe22d, user_id=2c5dcb2daada44b7b363e043a64b3827, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:22.700224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315e3c6-6d89-4bc4-a9e4-fe4822e518bd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:22.734243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 965/1908] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:22 2022] PUT /identity/v3/projects/db31923ed74b41a6888946787acfe22d/users/2c5dcb2daada44b7b363e043a64b3827/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:22.736942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.738667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.739416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.791085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] MFA Rules not processed for user `2c5dcb2daada44b7b363e043a64b3827`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:22.792379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:22.796486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f809266-c1c5-4395-947e-f9e1863b8117 service glance] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:22.894940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:22.969668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:22.970509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:22.970871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:22.971063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:22.977215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 966/1909] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:22 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:23.125195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:23.126681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:23.150487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 944/1910] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:23.331207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:23.333543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:23.343966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:23.363880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce88356b-f1e8-48f5-aa4a-c11b26963730 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:23.375487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:23.377962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:23.378853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:23.380427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:23.393297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:23.396136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:23.405883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 945/1911] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:23.409225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc5cde-bb11-4bff-ae3a-7fa0197067bf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:23.414062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:23.414934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:23.415248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:23.415613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] PATH_INFO: `/v3/projects/d76266a5146545baa3fc7bc6fe41bb06` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:23.416774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d76266a5146545baa3fc7bc6fe41bb06)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:23.418668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:23.433427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:23.606044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:23.611151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd76266a5146545baa3fc7bc6fe41bb06', 'request_id': 'req-76529218-be06-4481-b4c9-862ec05c937c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:23.614796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f69242-7a20-49f0-a141-30f786cc20b6 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:23.619534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd76266a5146545baa3fc7bc6fe41bb06', 'request_id': 'req-76529218-be06-4481-b4c9-862ec05c937c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:23.630097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:23.675463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:23.676152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:23.676438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:23.676865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:23.698705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:23.735463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd76266a5146545baa3fc7bc6fe41bb06', 'request_id': 'req-76529218-be06-4481-b4c9-862ec05c937c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:23.736628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:23.738202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:23.748251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 946/1912] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:23.767415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] The token cache is being invalidate because project d76266a5146545baa3fc7bc6fe41bb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:23.767415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:23.767415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:23.767415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 967/1913] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:23 2022] DELETE /identity/v3/projects/d76266a5146545baa3fc7bc6fe41bb06 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:23.770862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:23.832678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fea5b3-3900-4ad6-9255-5066e323bfc5 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:23.837538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:23.838418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:23.838708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:23.838992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] PATH_INFO: `/v3/users/1b2ccbde1a9d45e0a8480783a42b94f8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:23.840212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2ccbde1a9d45e0a8480783a42b94f8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:23.842131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:24.086506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2ccbde1a9d45e0a8480783a42b94f8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.101154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2ccbde1a9d45e0a8480783a42b94f8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.103679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:24.105163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:24.118088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76529218-be06-4481-b4c9-862ec05c937c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:24.122710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:24.123619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:24.123908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:24.124191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] PATH_INFO: `/v3/users/656925cce20d4fb2b7e207ec51e8f068` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:24.125424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656925cce20d4fb2b7e207ec51e8f068)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:24.127331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:24.163035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2ccbde1a9d45e0a8480783a42b94f8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.170581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2ccbde1a9d45e0a8480783a42b94f8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.171380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30c4b517-55d3-4f19-b9fb-dc2b3d1ef5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2ccbde1a9d45e0a8480783a42b94f8'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.181264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 947/1914] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:23 2022] DELETE /identity/v3/users/1b2ccbde1a9d45e0a8480783a42b94f8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:24.309365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656925cce20d4fb2b7e207ec51e8f068'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.310073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656925cce20d4fb2b7e207ec51e8f068'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.310689 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656925cce20d4fb2b7e207ec51e8f068'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.318590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656925cce20d4fb2b7e207ec51e8f068'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.337268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656925cce20d4fb2b7e207ec51e8f068'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.403542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 968/1915] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:24 2022] DELETE /identity/v3/users/656925cce20d4fb2b7e207ec51e8f068 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:24.411293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:24.411293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:24.411293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:24.430423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:24.431790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:24.481086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:24.501595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 948/1916] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:24.524335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:24.525454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:24.590233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642204e-8c33-4ff1-b157-8c3f8eb068f5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:24.593915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:24.594578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:24.594869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:24.600582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:24.604914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:24.606341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed6c8c-4c91-4325-adb0-3b21040a8e06 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:24.617241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 969/1917] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:24.658427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:24.662432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:24.679195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68704333-f44b-4cbe-b8d7-4f076a5876d0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:24.685662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:24.686723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:24.698796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:24.699121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] PATH_INFO: `/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:24.702792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c703e3e47ff148cbbf97004fe6e38fdb)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:24.708531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:24.735533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:24.849051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c703e3e47ff148cbbf97004fe6e38fdb', 'request_id': 'req-572666e7-0497-446c-96e8-1b027ec937dc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.855472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c703e3e47ff148cbbf97004fe6e38fdb', 'request_id': 'req-572666e7-0497-446c-96e8-1b027ec937dc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.982075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c703e3e47ff148cbbf97004fe6e38fdb', 'request_id': 'req-572666e7-0497-446c-96e8-1b027ec937dc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.997247 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] The token cache is being invalidate because project c703e3e47ff148cbbf97004fe6e38fdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:24.997540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:24.998209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-572666e7-0497-446c-96e8-1b027ec937dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.000086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 949/1918] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:24 2022] DELETE /identity/v3/projects/c703e3e47ff148cbbf97004fe6e38fdb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:25.005214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.005595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.005970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.052507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:25.052507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.135850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 970/1919] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:25.137916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.138211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.138498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.158526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:25.161239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.168266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 950/1920] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:25.173352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.184301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.189732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a6fd8-e0d5-45ed-9819-8798f6bd9957 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.189887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.194042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.194765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.195086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.195369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.196142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:25.196452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.198249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.203457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a6727-2fc0-4734-a062-b7bfc63300fd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.210361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.211037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.211334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.211653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 971/1921] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:25.215433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] PATH_INFO: `/v3/projects/7f75cb74f6d546199b8b2be5dbe95815` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.215973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.216619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f75cb74f6d546199b8b2be5dbe95815)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.227750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.229411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc640e-6789-4f46-a849-d115039f5641 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.239823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.241333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.241871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.242220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.243321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.245114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.365502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 972/1922] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:25.369565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.394033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f75cb74f6d546199b8b2be5dbe95815', 'request_id': 'req-30f5c255-209c-40fa-9803-b035438eea33'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.400197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f75cb74f6d546199b8b2be5dbe95815', 'request_id': 'req-30f5c255-209c-40fa-9803-b035438eea33'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.447043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23981e65-38d5-44c6-9226-a4fe9cd503ca admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.463119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f75cb74f6d546199b8b2be5dbe95815', 'request_id': 'req-30f5c255-209c-40fa-9803-b035438eea33'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.484564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] The token cache is being invalidate because project 7f75cb74f6d546199b8b2be5dbe95815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:25.485071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.486543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.489324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 951/1923] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:25 2022] DELETE /identity/v3/projects/7f75cb74f6d546199b8b2be5dbe95815 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:25.493323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.495093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.526003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.526465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.526891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.527217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.527968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.529889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.584968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5c255-209c-40fa-9803-b035438eea33 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.592142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.598773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.598773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.598773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] PATH_INFO: `/v3/users/2c5dcb2daada44b7b363e043a64b3827` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.599485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 973/1924] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:25.599773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5dcb2daada44b7b363e043a64b3827)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.599773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.601198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.603939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.619594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:25.629143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737689b6-0057-4762-872b-26585ea7c025 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.635516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.638278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.639241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.640200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.642039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.644451 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.660106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 974/1925] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:25.661525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.679323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86624f-63ee-4297-b5f4-cd335c2d0efe admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.684586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.685271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.685563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.685849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.686579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.688266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.703603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 975/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:25.705492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.719865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9fc13-3a67-400d-ba09-f252e6384469 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:25.726970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:25.727905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.728189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.728470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] PATH_INFO: `/v3/projects/09c12afe73f547baa701ab09556c88bd/users/74430aaedc2343ac8d5e49e93b4fa660/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.745687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09c12afe73f547baa701ab09556c88bd, user_id=74430aaedc2343ac8d5e49e93b4fa660, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:25.749371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73607f-e71d-48a0-8d92-74912a891932 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:25.840254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5dcb2daada44b7b363e043a64b3827'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.852169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5dcb2daada44b7b363e043a64b3827'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.860992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 976/1927] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:25 2022] PUT /identity/v3/projects/09c12afe73f547baa701ab09556c88bd/users/74430aaedc2343ac8d5e49e93b4fa660/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:25.873236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:25.873532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:25.873815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:25.902495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] MFA Rules not processed for user `74430aaedc2343ac8d5e49e93b4fa660`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:25.903758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:25.944995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5dcb2daada44b7b363e043a64b3827'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.954168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5dcb2daada44b7b363e043a64b3827'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.955319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5dcb2daada44b7b363e043a64b3827'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:25.964194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 952/1928] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:25 2022] DELETE /identity/v3/users/2c5dcb2daada44b7b363e043a64b3827 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:25.982663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 977/1929] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:25.987232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:25.994184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:26.048727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:26.074685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b764379-ec0d-4947-aee4-ad445dc34a45 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.091112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.091960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.092352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.092737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.093538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.096376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.255756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 953/1930] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:25 2022] POST /identity/v3/projects => generated 387 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:26.258684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.343224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5fa95-3e65-4753-94b3-fe62ec40f795 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.414987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.415834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.416188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.416539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.417315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.419342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.550033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 978/1931] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:26 2022] POST /identity/v3/users => generated 300 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:26.550325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.553665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.554135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:26.566908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891de0b-23d5-449b-9a86-a0443dff8380 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.568155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe597474-b752-4032-a264-3a03b3485b8d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.571801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.572506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.572894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.573209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.573648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.573948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.574973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.575363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.575618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.575930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] PATH_INFO: `/v3/projects/db31923ed74b41a6888946787acfe22d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.577266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db31923ed74b41a6888946787acfe22d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.579366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.592512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 979/1932] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:26.593542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.607105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317a540b-789a-46e1-966c-0b5ff59e7638 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.613315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.614476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.614860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.615244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] PATH_INFO: `/v3/projects/71ea31f8038f4850b0f28872949cada7/users/8cff261851b3492f9a5b48c8e8bcf808/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.641686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ea31f8038f4850b0f28872949cada7, user_id=8cff261851b3492f9a5b48c8e8bcf808, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.645009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.723333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 980/1933] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:26 2022] PUT /identity/v3/projects/71ea31f8038f4850b0f28872949cada7/users/8cff261851b3492f9a5b48c8e8bcf808/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:26.724475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.738774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db31923ed74b41a6888946787acfe22d', 'request_id': 'req-283a509d-c4ab-4470-8126-81ba40e10a26'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:26.747187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db31923ed74b41a6888946787acfe22d', 'request_id': 'req-283a509d-c4ab-4470-8126-81ba40e10a26'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:26.791653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db31923ed74b41a6888946787acfe22d', 'request_id': 'req-283a509d-c4ab-4470-8126-81ba40e10a26'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:26.803474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71dba73-7ae0-4498-a23e-b5b7d58bea16 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.814183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] The token cache is being invalidate because project db31923ed74b41a6888946787acfe22d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:26.814183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:26.814183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-283a509d-c4ab-4470-8126-81ba40e10a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:26.814183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 954/1934] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:26 2022] DELETE /identity/v3/projects/db31923ed74b41a6888946787acfe22d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:26.814183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1b42-4862-44c1-aba1-1113ca2d61a6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.814612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1b42-4862-44c1-aba1-1113ca2d61a6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.814612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d1b42-4862-44c1-aba1-1113ca2d61a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.836370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a08d1b42-4862-44c1-aba1-1113ca2d61a6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:26.837474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a08d1b42-4862-44c1-aba1-1113ca2d61a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:26.885336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.886322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.886795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.887297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.889055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.899028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.911590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 981/1935] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:26.915634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:26.919100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:26.935783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67d0d9-1147-47de-804e-c91705c7ccf8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:26.943171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:26.944447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.945181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.945625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] PATH_INFO: `/v3/projects/71ea31f8038f4850b0f28872949cada7/users/8cff261851b3492f9a5b48c8e8bcf808/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.949140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ea31f8038f4850b0f28872949cada7, user_id=8cff261851b3492f9a5b48c8e8bcf808, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:26.952271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a88387-c4ec-47bf-8d9d-cab226f57cbe admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:26.953855 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 955/1936] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:26.963644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.970949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.970949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.971371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 982/1937] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:26 2022] PUT /identity/v3/projects/71ea31f8038f4850b0f28872949cada7/users/8cff261851b3492f9a5b48c8e8bcf808/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:26.981183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:26.981482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:26.981773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:26.988964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:26.990735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:27.016928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] MFA Rules not processed for user `8cff261851b3492f9a5b48c8e8bcf808`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:27.018358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:27.090209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:27.091723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 956/1938] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:27.092974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.107590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8609e8-14a4-4958-96b8-ad0b9931bab5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.114286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.114977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.115268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.115580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.120189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:27.120189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.120189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.139517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 957/1939] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:27.140597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.141551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:27.145365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 983/1940] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:27.155593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8d172-710d-48c9-88f2-02fc1cd7b30f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.159325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.161546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:27.161660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.162367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.162644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.162932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.163731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.167350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.246545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8213a3-8bc8-40a9-bc9f-bb77ca342837 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.250593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.252904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.253329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.253627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.267392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.269959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.286840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 984/1941] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:27.297712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 958/1942] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:27 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:27.302495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.326010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b72c7-24ef-4117-96d5-c89c8fe9ec67 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.419467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.420294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.420584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.420866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.421761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.424822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.440356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.461059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b6dad-61f0-4b3d-9a41-db796705ff55 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.475042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.477451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.477451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.477451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] PATH_INFO: `/v3/users/74430aaedc2343ac8d5e49e93b4fa660` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.478182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=74430aaedc2343ac8d5e49e93b4fa660)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.480329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.524057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 985/1943] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:27 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:27.525420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.539204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453253f4-744a-45a6-8a07-644c44ca9012 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.546679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.547594 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.548148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.548531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.549567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.551828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.569246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 986/1944] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:27.571485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.589380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5039e-3c6a-404a-85f2-b527cd4d203f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.603921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:27.610821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.611907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.612199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.612481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.615279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.620878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.660779 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 987/1945] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:27.665072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.693785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f3a4c-473e-4d03-a24b-00ef7d966b39 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:27.703907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74430aaedc2343ac8d5e49e93b4fa660'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:27.704923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:27.706324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.707099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.707527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] PATH_INFO: `/v3/projects/865019aef812439f9a7c8d28d38f8623/users/6328ea929a8641f78744160e8f7e8ed7/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.720205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74430aaedc2343ac8d5e49e93b4fa660'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:27.725961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=865019aef812439f9a7c8d28d38f8623, user_id=6328ea929a8641f78744160e8f7e8ed7, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:27.728877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:27.811281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74430aaedc2343ac8d5e49e93b4fa660'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:27.829499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74430aaedc2343ac8d5e49e93b4fa660'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:27.830782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e115fbe0-3c01-4a6b-817d-984eeef35dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74430aaedc2343ac8d5e49e93b4fa660'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:27.833882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 988/1946] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:27 2022] PUT /identity/v3/projects/865019aef812439f9a7c8d28d38f8623/users/6328ea929a8641f78744160e8f7e8ed7/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:27.836821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:27.846425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 959/1947] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:27 2022] DELETE /identity/v3/users/74430aaedc2343ac8d5e49e93b4fa660 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:27.846525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:27.846608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49731ba-b8ed-4530-b9ae-b7a3c6b99ece None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:27.846608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49731ba-b8ed-4530-b9ae-b7a3c6b99ece None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:27.846608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49731ba-b8ed-4530-b9ae-b7a3c6b99ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:27.868756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a49731ba-b8ed-4530-b9ae-b7a3c6b99ece None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:27.874624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a49731ba-b8ed-4530-b9ae-b7a3c6b99ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:27.955756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbcb98d-2387-4b15-9c9e-07797a4fe6bc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:28.043966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 960/1948] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:28.052486 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.052886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.054932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.102121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:28.103354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:28.107028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:28.108070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.110599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.110599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] PATH_INFO: `/v3/users/3cafecfc9b004534a3b4bd1cb1c60116` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.110599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cafecfc9b004534a3b4bd1cb1c60116)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:28.114035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:28.132742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 961/1949] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:28.137142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:28.139405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:28.205453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c378727-9629-44fe-a0c2-b85aceee58c0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:28.210273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:28.211143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.214075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.214603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.226263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:28.227761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:28.238875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 962/1950] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:28.239839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:28.249551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f46e-533f-4366-ba37-498c05600310 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:28.252637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:28.257013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:28.257013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.257013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.257013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.273204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:28.276336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604043d-d565-4fc8-97f0-b9e7cc803344 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:28.288608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 963/1951] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:28.381288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cafecfc9b004534a3b4bd1cb1c60116'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:28.381958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cafecfc9b004534a3b4bd1cb1c60116'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:28.382573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cafecfc9b004534a3b4bd1cb1c60116'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:28.390958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cafecfc9b004534a3b4bd1cb1c60116'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:28.406833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cafecfc9b004534a3b4bd1cb1c60116'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:28.496232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 989/1952] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:27 2022] DELETE /identity/v3/users/3cafecfc9b004534a3b4bd1cb1c60116 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:28.501547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970731-dd05-4822-881e-f453d19f86dc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.501840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970731-dd05-4822-881e-f453d19f86dc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.502121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970731-dd05-4822-881e-f453d19f86dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.527807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-51970731-dd05-4822-881e-f453d19f86dc None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:28.529029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-51970731-dd05-4822-881e-f453d19f86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:28.592525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 964/1953] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:28.619448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:28.621753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:28.716088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82596a-6ed3-4a24-8a17-31fc542fa347 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:28.723394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:28.724807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:28.724807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:28.725008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:28.736444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:28.739202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:28.748689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:28.752847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 990/1954] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:28.998801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970731-dd05-4822-881e-f453d19f86dc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:29.021718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-51970731-dd05-4822-881e-f453d19f86dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:29.081104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970731-dd05-4822-881e-f453d19f86dc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:29.095742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:29.100975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:29.101341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:29.101696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] PATH_INFO: `/v3/projects/09c12afe73f547baa701ab09556c88bd` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:29.103792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=09c12afe73f547baa701ab09556c88bd)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:29.108179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:29.196906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:29.247973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09c12afe73f547baa701ab09556c88bd', 'request_id': 'req-f0948390-586e-4f54-8737-d59929211cbc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.267498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09c12afe73f547baa701ab09556c88bd', 'request_id': 'req-f0948390-586e-4f54-8737-d59929211cbc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.376391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09c12afe73f547baa701ab09556c88bd', 'request_id': 'req-f0948390-586e-4f54-8737-d59929211cbc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.399927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] The token cache is being invalidate because project 09c12afe73f547baa701ab09556c88bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:29.400493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.401426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.403896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 965/1955] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:28 2022] DELETE /identity/v3/projects/09c12afe73f547baa701ab09556c88bd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:29.407743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:29.422114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728aea3e-6b09-438a-bae4-356654df34b7 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:29.570843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:29.571799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:29.572100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:29.572372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] PATH_INFO: `/v3/users/8cff261851b3492f9a5b48c8e8bcf808` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:29.573691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cff261851b3492f9a5b48c8e8bcf808)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:29.575665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:29.615683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:29.829795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:29.830777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:29.856828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0948390-586e-4f54-8737-d59929211cbc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:29.857092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cff261851b3492f9a5b48c8e8bcf808'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.857092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cff261851b3492f9a5b48c8e8bcf808'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.857598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:29.858474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cff261851b3492f9a5b48c8e8bcf808'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.858861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:29.859113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:29.863717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] PATH_INFO: `/v3/projects/5508b8e1aea94735b2bbd25f9de8bb5f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:29.866210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5508b8e1aea94735b2bbd25f9de8bb5f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:29.870535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:29.872520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cff261851b3492f9a5b48c8e8bcf808'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.886682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cff261851b3492f9a5b48c8e8bcf808'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.966960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 991/1956] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:29 2022] DELETE /identity/v3/users/8cff261851b3492f9a5b48c8e8bcf808 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:29.983047 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5508b8e1aea94735b2bbd25f9de8bb5f', 'request_id': 'req-3950a003-c369-448f-9142-a25544ff26fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:29.995927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5508b8e1aea94735b2bbd25f9de8bb5f', 'request_id': 'req-3950a003-c369-448f-9142-a25544ff26fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.072392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5508b8e1aea94735b2bbd25f9de8bb5f', 'request_id': 'req-3950a003-c369-448f-9142-a25544ff26fc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.085917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] The token cache is being invalidate because project 5508b8e1aea94735b2bbd25f9de8bb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:30.086523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.086938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3950a003-c369-448f-9142-a25544ff26fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.088621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 966/1957] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:29 2022] DELETE /identity/v3/projects/5508b8e1aea94735b2bbd25f9de8bb5f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:30.092735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:30.094210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:30.200387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb15f5d-62f3-4ca1-ae41-9a708476a137 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:30.208027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:30.208988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:30.209284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:30.209568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] PATH_INFO: `/v3/users/c217cc0d2c3e4211ae99c1020ecc3f46` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:30.211027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c217cc0d2c3e4211ae99c1020ecc3f46)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:30.213323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:30.267807 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf553b-0688-4285-a711-04ababc09886 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:30.270326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf553b-0688-4285-a711-04ababc09886 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:30.270326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf553b-0688-4285-a711-04ababc09886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:30.321537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-39cf553b-0688-4285-a711-04ababc09886 None None] MFA Rules not processed for user `6328ea929a8641f78744160e8f7e8ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:30.323111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39cf553b-0688-4285-a711-04ababc09886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:30.392401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:30.433432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 967/1958] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:30.435595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf553b-0688-4285-a711-04ababc09886 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:30.442993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39cf553b-0688-4285-a711-04ababc09886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:30.469715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf553b-0688-4285-a711-04ababc09886 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:30.477711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:30.479584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:30.480085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:30.482772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c217cc0d2c3e4211ae99c1020ecc3f46'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.483572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c217cc0d2c3e4211ae99c1020ecc3f46'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.485751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c217cc0d2c3e4211ae99c1020ecc3f46'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.496754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:30.497599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:30.498185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c217cc0d2c3e4211ae99c1020ecc3f46'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.502062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:30.542132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c217cc0d2c3e4211ae99c1020ecc3f46'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:30.601736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 968/1959] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:30 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:30.605087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:30.619701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:30.623763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 992/1960] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:30 2022] DELETE /identity/v3/users/c217cc0d2c3e4211ae99c1020ecc3f46 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:30.786139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cafbb5-43a9-4f57-8e27-689120ceaf03 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:30.858800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:30.860088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:30.860381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:30.860662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:30.861403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:30.864515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:30.956992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:30.958686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:30.975161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc1848-5558-440d-82e6-5c6972ee883e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:30.984283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:30.985673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:30.986177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:30.986630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] PATH_INFO: `/v3/projects/71ea31f8038f4850b0f28872949cada7` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:30.988253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ea31f8038f4850b0f28872949cada7)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:30.991189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.026389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 969/1961] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:30 2022] POST /identity/v3/users => generated 292 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:31.031466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.047863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a94c298-6ae8-44c5-84da-cd77eed88209 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.055912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.056952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.057427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.057872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.058785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.061319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.079598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:31.080535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 970/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:31.083872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.095579 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af4fc8-06f3-4ead-9bcd-e3028e2fe375 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.119823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.121261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.121617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.121968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] PATH_INFO: `/v3/projects/28b847dc93ff4befbdba146b0aa2438b/users/649c9b70303d4076a53af89ce01d9c9d/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.159267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ea31f8038f4850b0f28872949cada7', 'request_id': 'req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.169653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b847dc93ff4befbdba146b0aa2438b, user_id=649c9b70303d4076a53af89ce01d9c9d, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.174395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ea31f8038f4850b0f28872949cada7', 'request_id': 'req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.176385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.283159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ea31f8038f4850b0f28872949cada7', 'request_id': 'req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.295349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] The token cache is being invalidate because project 71ea31f8038f4850b0f28872949cada7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:31.295668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.296310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-854f5c41-a5a6-46b7-a05f-4673bcc2ee20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.297871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 993/1963] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:30 2022] DELETE /identity/v3/projects/71ea31f8038f4850b0f28872949cada7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:31.304641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.304800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.304995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.313155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 971/1964] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:31 2022] PUT /identity/v3/projects/28b847dc93ff4befbdba146b0aa2438b/users/649c9b70303d4076a53af89ce01d9c9d/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:31.322285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.324320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.325265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:31.326568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.397918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd975-c172-43a6-b56e-c8c47b6eb40f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.408506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.414687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 994/1965] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:31.414885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.414885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.414885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.415197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.415291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.415380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.415463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22cd1d-58f5-421d-9ce9-3b7a692da961 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.425775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85dbc0-443c-4457-80de-a87f85d4b590 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.429003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 972/1966] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:31.431714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.431714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.432206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.434955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.435967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.436311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.436662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] PATH_INFO: `/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.438014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=299c8e2ed5f64ede81437ca33a25fd1f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.440060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.453653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:31.453653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.461261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 973/1967] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:31.462169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.472738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c441b17-13d0-4e83-9001-af83a8927b10 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.477404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.478289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.478576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.478854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] PATH_INFO: `/v3/projects/28b847dc93ff4befbdba146b0aa2438b/users/649c9b70303d4076a53af89ce01d9c9d/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.480889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b847dc93ff4befbdba146b0aa2438b, user_id=649c9b70303d4076a53af89ce01d9c9d, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.483529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.495436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 974/1968] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:31 2022] PUT /identity/v3/projects/28b847dc93ff4befbdba146b0aa2438b/users/649c9b70303d4076a53af89ce01d9c9d/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:31.500002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.525541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:31.535287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '299c8e2ed5f64ede81437ca33a25fd1f', 'request_id': 'req-bcbd9f96-a196-423c-85db-e42e8e7f7a86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.541012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '299c8e2ed5f64ede81437ca33a25fd1f', 'request_id': 'req-bcbd9f96-a196-423c-85db-e42e8e7f7a86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.563630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc84366-e3c5-473a-a55d-b4865caf9929 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.569878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:31.590537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '299c8e2ed5f64ede81437ca33a25fd1f', 'request_id': 'req-bcbd9f96-a196-423c-85db-e42e8e7f7a86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.605141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] The token cache is being invalidate because project 299c8e2ed5f64ede81437ca33a25fd1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:31.605595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.606469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-bcbd9f96-a196-423c-85db-e42e8e7f7a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:31.608178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 995/1969] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:31 2022] DELETE /identity/v3/projects/299c8e2ed5f64ede81437ca33a25fd1f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:31.613402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b90c-5744-470f-9bdf-bd13ebdca5fc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.614001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b90c-5744-470f-9bdf-bd13ebdca5fc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.614374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b90c-5744-470f-9bdf-bd13ebdca5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.634414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3700b90c-5744-470f-9bdf-bd13ebdca5fc None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:31.635945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3700b90c-5744-470f-9bdf-bd13ebdca5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.646354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.647709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.647709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.647890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.648568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:31.648943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.650875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.655871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 996/1970] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:31.662037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.662339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.662769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.669234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 975/1971] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:31.673642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.676241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.692322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762cb58-ec3c-4ab9-8863-1ddc6beb7964 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.695303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:31.697766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:31.700304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.700926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.701356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.701738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.702616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.710709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.722861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 997/1972] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:31.723922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.740332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5db0a8-788e-48ec-9296-16ae85e4e591 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.745219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.745916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.746204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.746491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.747209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:31.747518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.749143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.761416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 998/1973] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:31.768527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.778604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dd64d-0d8e-4cca-89a2-b8b85d937402 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.783277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:31.784065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:31.784915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:31.785256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:31.785950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:31.787925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:31.842524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 976/1974] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:31.844326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:31.921346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554328a-54ed-48ed-9601-d37b69251792 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:31.924680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 999/1975] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:31.925740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.006163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae4b5bd-8d5b-447b-b454-13651e49c002 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.011221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.012002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.012254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.012891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.013157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.013361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.013577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.013917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.014389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.014739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.017049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.017200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.041627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:32.118100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1000/1976] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:32.122038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.135261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:32.151829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a743bb-88ea-46c6-9dc6-7a1611ec3bcd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.154227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 977/1977] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:31 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:32.158138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.160003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.160796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.161609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.162051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.162985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.164797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.179002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1001/1978] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:32.191783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369fa2b-5800-41c1-b281-db00657b4f42 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.191783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.191783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.191783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.192150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.192150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.192150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.196300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.205325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 978/1979] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:32.212483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.216353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b12b3-2231-4d9d-afee-834d68a369b6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.226838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.227168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238d8c2-3e22-4cbc-bd71-74a60c48667b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.230291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.230291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.230291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.230291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.231599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.233388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.234077 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.234520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.235240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.235615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.237413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.251731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1002/1980] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:32.251959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 979/1981] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:32.256744 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.258451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.270408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5369b-7456-423a-9b73-f1be77302082 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.274647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1d114-77ea-4445-99e9-82a91905c632 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.276306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.277157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.278336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.278616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.278943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] PATH_INFO: `/v3/projects/86460d91d5cc449f899ae93d6d84b54e/users/a89604df7d3d4539a5a252859a216ef5/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.279342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.279786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.280190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] PATH_INFO: `/v3/projects/7f3d10aef6a043f298de646de4e5bdc5/users/fb0de0b23cba42ac82df7e3bc1d359ce/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.302933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f3d10aef6a043f298de646de4e5bdc5, user_id=fb0de0b23cba42ac82df7e3bc1d359ce, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.306816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268b1ca-17f8-45c1-b629-9d0d24ccded5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.312212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86460d91d5cc449f899ae93d6d84b54e, user_id=a89604df7d3d4539a5a252859a216ef5, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.314949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82aadab-ea85-4df0-92da-47fd66801d2d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.392123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1003/1982] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:32 2022] PUT /identity/v3/projects/7f3d10aef6a043f298de646de4e5bdc5/users/fb0de0b23cba42ac82df7e3bc1d359ce/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:32.403248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.403543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.403853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.432558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] MFA Rules not processed for user `fb0de0b23cba42ac82df7e3bc1d359ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:32.433947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:32.443450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 980/1983] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:32 2022] PUT /identity/v3/projects/86460d91d5cc449f899ae93d6d84b54e/users/a89604df7d3d4539a5a252859a216ef5/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:32.454049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.454586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.454875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.496942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] MFA Rules not processed for user `a89604df7d3d4539a5a252859a216ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:32.498211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:32.544352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1004/1984] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:32.548586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.610205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:32.620559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 981/1985] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:32.631797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.632170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a394056-3dd7-4c2f-88cd-819c9a07089b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.637735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.638756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.639230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.639773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.640791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.642878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.646381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d2fb4-2ab1-4185-84ad-b0edd6bef9d9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.668251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.674489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.674489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.674489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.674489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.674489 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.730444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1005/1986] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:32.734488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.772156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 982/1987] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:32.775910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.858678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6f102-fe9b-4460-a390-c0e9f39d2849 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.863196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d07b6-9c41-4c34-be8a-4357101f0283 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:32.865227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.865939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.866231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.866512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.867220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.869131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:32.873850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.873982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:32.873982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:32.873982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:32.873982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:32.873982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:32.979732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 983/1988] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:32.983281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1006/1989] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:32 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:32.987242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:32.987441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.007475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bcfe05-76c0-47a2-a144-8e7710d1b497 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.018133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.019915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.020253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92bc2-00a4-4e3e-a3dd-ca5b02b165bf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.020634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.021224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.022611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.025650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8e55-2ca9-4347-9c21-858b9ebbb9c9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.046050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.046050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.046050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.046050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.046556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.050548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.068919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 984/1990] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:33.069513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.069811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.073026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.080182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1007/1991] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:33.083755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.100149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05585-dc22-43ff-967d-95de012cbc7f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.113636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.114559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.114852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.118340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:33.118964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] PATH_INFO: `/v3/projects/ad60174f6f9f409cb960c21abba5ec9d/users/7ef237ad2299441099a08eb2b24f401d/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.131156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] MFA Rules not processed for user `649c9b70303d4076a53af89ce01d9c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:33.132625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.156763 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad60174f6f9f409cb960c21abba5ec9d, user_id=7ef237ad2299441099a08eb2b24f401d, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.161827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c10489-eddc-4ae2-a07b-c979df31f475 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.215747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 985/1992] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:33.216544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.240557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cd42fd-e143-41e7-b3d6-1948da6feda9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.245681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.246593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.246881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.247166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] PATH_INFO: `/v3/projects/35575fc0794c421a978ed24ac910629d/users/13dd6c6d512649a6a8f7af3cceafde36/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.266645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35575fc0794c421a978ed24ac910629d, user_id=13dd6c6d512649a6a8f7af3cceafde36, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.270768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.297985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1008/1993] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:33 2022] PUT /identity/v3/projects/ad60174f6f9f409cb960c21abba5ec9d/users/7ef237ad2299441099a08eb2b24f401d/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:33.300490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.300975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.301462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.321557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] MFA Rules not processed for user `6328ea929a8641f78744160e8f7e8ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:33.322955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.346520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 986/1994] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:33 2022] PUT /identity/v3/projects/35575fc0794c421a978ed24ac910629d/users/13dd6c6d512649a6a8f7af3cceafde36/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:33.349209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.445733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1009/1995] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:33.446742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.461083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62b052-4bc3-4d26-ac1f-6bdbe1b0e5b6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.468055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.468953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.469473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.469927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.470662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.472944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.484116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 987/1996] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:33.484975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.489129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.525526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cd4c9-674b-492a-8d43-0ff0434beae0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.531077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.531811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.532154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.532440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.533229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.535465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.541068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:33.551284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1010/1997] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:33.552363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.563258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8c696-51ab-4c3e-926e-ccdc002144fe admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.569118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.570018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.570664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.570664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] PATH_INFO: `/v3/projects/ad60174f6f9f409cb960c21abba5ec9d/users/7ef237ad2299441099a08eb2b24f401d/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.572725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad60174f6f9f409cb960c21abba5ec9d, user_id=7ef237ad2299441099a08eb2b24f401d, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.575824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.588713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73224ceb-404f-48c4-a0e8-552462465cd7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.590927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1011/1998] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:33 2022] PUT /identity/v3/projects/ad60174f6f9f409cb960c21abba5ec9d/users/7ef237ad2299441099a08eb2b24f401d/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:33.602021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.678483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:33.700075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02456e-c065-4493-bae1-0db44deeee6e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:33.702913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.705379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.705915 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.706978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.709287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.716906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:33.718182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.721069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.721563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] PATH_INFO: `/v3/projects/35575fc0794c421a978ed24ac910629d/users/13dd6c6d512649a6a8f7af3cceafde36/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.725948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35575fc0794c421a978ed24ac910629d, user_id=13dd6c6d512649a6a8f7af3cceafde36, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.730362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f911808-ee86-4f01-a273-0f4b8107a327 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.744956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1012/1999] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:33 2022] PUT /identity/v3/projects/35575fc0794c421a978ed24ac910629d/users/13dd6c6d512649a6a8f7af3cceafde36/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:33.750290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.750290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.750290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.782870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] MFA Rules not processed for user `7ef237ad2299441099a08eb2b24f401d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:33.784200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.805810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:33.809545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc44b7-fb2d-42d4-9f4f-7225ffd7d2e9 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:33.822182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 988/2000] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:33.823909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:33.824205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:33.824490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:33.874518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] MFA Rules not processed for user `13dd6c6d512649a6a8f7af3cceafde36`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:33.876189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.894462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:33.899740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1013/2001] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:33.913310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:33.915360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:33.983418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 989/2002] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:34.002175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a643b-cd15-407f-a3e4-961f3380d47a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:34.007740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:34.008554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:34.008922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:34.009278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:34.020882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.026486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:34.033931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:34.041714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1014/2003] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:34.197565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:34.206306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.212292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f20b905-b2fd-4dfc-9d6d-a42d027e1efc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:34.217039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:34.218719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:34.219064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:34.219481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:34.334339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:34.336078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119bf0-9ae8-4913-bf5d-b2c309f3d6ac service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:34.349873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 990/2004] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:34.408783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.655942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.869843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:34.879827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:34.955126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3e3d0f-7785-4758-958c-a77929349e37 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:34.960495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:34.961383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:34.961705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:34.961945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] PATH_INFO: `/v3/users/a89604df7d3d4539a5a252859a216ef5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:34.963226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89604df7d3d4539a5a252859a216ef5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:34.965255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:35.201499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89604df7d3d4539a5a252859a216ef5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:35.202805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89604df7d3d4539a5a252859a216ef5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:35.204193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89604df7d3d4539a5a252859a216ef5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:35.215926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89604df7d3d4539a5a252859a216ef5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:35.231442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89604df7d3d4539a5a252859a216ef5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:35.312315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1015/2005] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:34 2022] DELETE /identity/v3/users/a89604df7d3d4539a5a252859a216ef5 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:35.317459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:35.320332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:35.320332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:35.363714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:35.365508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:35.463611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 991/2006] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:35.475182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:35.477494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:35.620387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0825a41-dc7d-46a1-8ab9-df7ba8ca7ff9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:35.621436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:35.622291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:35.622910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:35.623287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:35.638758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:35.656210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:35.669925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1016/2007] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:35.903647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:36.180607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:36.223905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:36.225372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:36.246932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631d349-ff4c-41e4-8d44-f82f96c0d43c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:36.266978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:36.268133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:36.269116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:36.269581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] PATH_INFO: `/v3/projects/86460d91d5cc449f899ae93d6d84b54e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:36.273517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86460d91d5cc449f899ae93d6d84b54e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:36.275567 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:36.419090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86460d91d5cc449f899ae93d6d84b54e', 'request_id': 'req-d8b59347-7c9c-496c-a249-48b7f072b0a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.432031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86460d91d5cc449f899ae93d6d84b54e', 'request_id': 'req-d8b59347-7c9c-496c-a249-48b7f072b0a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.541456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86460d91d5cc449f899ae93d6d84b54e', 'request_id': 'req-d8b59347-7c9c-496c-a249-48b7f072b0a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.554959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] The token cache is being invalidate because project 86460d91d5cc449f899ae93d6d84b54e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:36.555866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.556551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.559102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 992/2008] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:36 2022] DELETE /identity/v3/projects/86460d91d5cc449f899ae93d6d84b54e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:36.563395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:36.578683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b24300-273b-48d5-b088-b8a2ec3516e0 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:36.675977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:36.675977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:36.676257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:36.676406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] PATH_INFO: `/v3/users/7ef237ad2299441099a08eb2b24f401d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:36.677658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef237ad2299441099a08eb2b24f401d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:36.679635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:36.722346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:36.926336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef237ad2299441099a08eb2b24f401d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.926935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef237ad2299441099a08eb2b24f401d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.927822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef237ad2299441099a08eb2b24f401d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.935821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef237ad2299441099a08eb2b24f401d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:36.964205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef237ad2299441099a08eb2b24f401d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.055606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1017/2009] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:36 2022] DELETE /identity/v3/users/7ef237ad2299441099a08eb2b24f401d => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:37.095505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:37.403461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:37.526472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:37.528059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:37.548271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:37.549800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:37.552590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59347-7c9c-496c-a249-48b7f072b0a5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:37.611349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:37.612447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.612947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.613298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ece1a8-4e60-4221-82ed-944b3305b054 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:37.613759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] PATH_INFO: `/v3/projects/ad60174f6f9f409cb960c21abba5ec9d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.615440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:37.616569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad60174f6f9f409cb960c21abba5ec9d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:37.616995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:37.617741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.618029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.618303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.618569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:37.620207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:37.683383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:37.684834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e210b-fb71-42d2-b4d4-e1dcaeca18a1 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:37.694888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1018/2010] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:37.718714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad60174f6f9f409cb960c21abba5ec9d', 'request_id': 'req-ff897bb7-2b36-41f6-ab5b-48934573c93e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.724690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad60174f6f9f409cb960c21abba5ec9d', 'request_id': 'req-ff897bb7-2b36-41f6-ab5b-48934573c93e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.762691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:37.790158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad60174f6f9f409cb960c21abba5ec9d', 'request_id': 'req-ff897bb7-2b36-41f6-ab5b-48934573c93e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.802543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] The token cache is being invalidate because project ad60174f6f9f409cb960c21abba5ec9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:37.802831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.803492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ff897bb7-2b36-41f6-ab5b-48934573c93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:37.805066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 993/2011] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:37 2022] DELETE /identity/v3/projects/ad60174f6f9f409cb960c21abba5ec9d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:37.810672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.810970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.811284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.831358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:37.832598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:37.892866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1019/2012] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:37.900888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5754-6442-4101-a715-53368446ccf5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.901188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5754-6442-4101-a715-53368446ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.901473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b5754-6442-4101-a715-53368446ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.920200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-979b5754-6442-4101-a715-53368446ccf5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:37.922289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-979b5754-6442-4101-a715-53368446ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:37.931729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 994/2013] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:37.936130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:37.948144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d06242-c70c-4c2a-9652-aaf8f9b42046 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:37.952764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:37.953424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.953713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.953979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.954792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:37.955212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:37.957531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:37.972629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1020/2014] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:37.978155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b5754-6442-4101-a715-53368446ccf5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:37.986955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b5754-6442-4101-a715-53368446ccf5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:37.992301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:37.993002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:37.993235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:37.993514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:37.994256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:37.996220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.090596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.093143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 995/2015] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:37 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:38.098055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.109024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef81dbc-3ea3-40bb-ac22-463cd177d62e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.173889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.174571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.175448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.176002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.176688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.178833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.214350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.249101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1021/2016] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:38 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:38.253701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.264680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214d1b28-42cf-4667-9b34-a77588c74ae0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.269675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.270352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.270650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.270933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.271695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.273298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.283863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 996/2017] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:38.288600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.298444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044e76f9-a246-41f4-8350-e45c09be5f14 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.304335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.305012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.305304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.305613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.306350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.307955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a39a-d27e-4702-a926-e4d4c9a08155 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.319624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1022/2018] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:38.322692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.332834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11e18-a83e-4dbc-a688-0124204cbbfc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.337539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.338468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.340167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.340167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] PATH_INFO: `/v3/projects/6ed67f9dd42f43e7b328e5e89668bb54/users/be95e45d176e4988bbed47644ef7fd4f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.356197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed67f9dd42f43e7b328e5e89668bb54, user_id=be95e45d176e4988bbed47644ef7fd4f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.359050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.391476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.426998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 997/2019] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:38 2022] PUT /identity/v3/projects/6ed67f9dd42f43e7b328e5e89668bb54/users/be95e45d176e4988bbed47644ef7fd4f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:38.437116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.437497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.437845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.466383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] MFA Rules not processed for user `be95e45d176e4988bbed47644ef7fd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:38.467615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:38.533096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1023/2020] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:38.540278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.544724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.547071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:38.603484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78208220-2e87-4181-a161-b2b981549109 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.607211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.607895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.608178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.608455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.616636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.618055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c0503-e36c-475a-a6c3-94173035bab4 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.627117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 998/2021] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:38.628951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.647354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:38.715580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8e442-97a9-407e-a681-603a3d295486 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:38.720374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:38.721277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:38.722168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:38.723264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] PATH_INFO: `/v3/users/be95e45d176e4988bbed47644ef7fd4f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:38.724504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be95e45d176e4988bbed47644ef7fd4f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:38.726430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:38.820084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.909142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:38.912399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be95e45d176e4988bbed47644ef7fd4f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:38.913072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be95e45d176e4988bbed47644ef7fd4f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:38.913702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be95e45d176e4988bbed47644ef7fd4f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:38.920538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be95e45d176e4988bbed47644ef7fd4f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:38.933771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be95e45d176e4988bbed47644ef7fd4f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:39.037992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1024/2022] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:38 2022] DELETE /identity/v3/users/be95e45d176e4988bbed47644ef7fd4f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:39.041368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:39.041830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:39.042580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:39.063195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:39.068080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:39.112586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:39.135580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 999/2023] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:39.147343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:39.150541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:39.208337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802433e3-c51a-4135-a50f-01291b5e2724 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:39.212076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:39.212823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:39.213181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:39.213472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:39.223308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:39.224794 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67e25-d0e3-4b24-a00f-34d079830c6e service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:39.234889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1025/2024] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:39.266383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:39.717751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:39.798920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:39.800599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:39.813052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fa46d-9607-4f8d-99b6-5d273c77929a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:39.818456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:39.820178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:39.820178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:39.820178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] PATH_INFO: `/v3/projects/6ed67f9dd42f43e7b328e5e89668bb54` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:39.821326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed67f9dd42f43e7b328e5e89668bb54)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:39.823281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:39.888886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:39.925717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed67f9dd42f43e7b328e5e89668bb54', 'request_id': 'req-c631b64e-a138-4634-ba76-2b36011b3b64'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:39.931521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed67f9dd42f43e7b328e5e89668bb54', 'request_id': 'req-c631b64e-a138-4634-ba76-2b36011b3b64'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:40.014574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed67f9dd42f43e7b328e5e89668bb54', 'request_id': 'req-c631b64e-a138-4634-ba76-2b36011b3b64'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:40.034055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] The token cache is being invalidate because project 6ed67f9dd42f43e7b328e5e89668bb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:40.034055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:40.034055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c631b64e-a138-4634-ba76-2b36011b3b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:40.034055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1000/2025] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:39 2022] DELETE /identity/v3/projects/6ed67f9dd42f43e7b328e5e89668bb54 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:40.035850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.036004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.036289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.060174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:40.062100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:40.131736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1026/2026] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:40.137572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.137863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.138143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.156628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:40.157841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:40.166218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1001/2027] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:40.171071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.183109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186728f-a529-491b-8fb1-b9970d2298fd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.188432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.189096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.189382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.190072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.191885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:40.192200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.193962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.211468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1027/2028] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:40.213274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.224696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff79995-5cbb-47fd-9065-cd9e3df366d4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.231154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.232160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.232747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.233079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.233871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.235943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.282899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:40.351259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1002/2029] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:40 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:40.352476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.362426 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f8386-bcb3-4eb9-a50f-0172c2be32d9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.423799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.424411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.425469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.425772 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.426511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.428453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.512624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1028/2030] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:40 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:40.516841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.539302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f8cd7-71c6-4559-996a-2d0e4e6c63fa admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.545285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.546442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.546850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.547271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.548449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.550466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.562330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1003/2031] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:40.566990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.577621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771da3e5-d0f9-4a5c-8b13-61cf8d84e301 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.585971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.587447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.588854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.589313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.590774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.593041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc3c71-9d49-4ede-ad7b-2ad31df3a045 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.606658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1029/2032] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:40.610865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.626030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a8343-58c2-49fa-9d0e-92dd1bea5573 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.632702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.633760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.634120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.634523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] PATH_INFO: `/v3/projects/a0856375c86440b1b35d22ef85731e46/users/06d201f1ca1b4f27bc02c6038c94daf3/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.652745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0856375c86440b1b35d22ef85731e46, user_id=06d201f1ca1b4f27bc02c6038c94daf3, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.663863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.717408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1004/2033] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:40 2022] PUT /identity/v3/projects/a0856375c86440b1b35d22ef85731e46/users/06d201f1ca1b4f27bc02c6038c94daf3/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:40.728311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.728792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.729046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.757816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] MFA Rules not processed for user `06d201f1ca1b4f27bc02c6038c94daf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:40.759077 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:40.828815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1030/2034] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:40.842015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:40.842575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:40.844578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:40.918458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48b417e-6441-480d-885a-5eff8133ec8b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:40.928314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:40.928314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:40.928314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:40.928314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:40.933232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:40.934612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef1b1e-a6b9-4c76-8bbf-4edf14ea9bfa service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:40.944239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1005/2035] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:41.708913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:42.140309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:42.797108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:43.043305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:43.116528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:43.117978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:43.190668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1524a-c7ad-46ba-a3f1-041ca2f17ca3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:43.195646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:43.196478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:43.196771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:43.197054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] PATH_INFO: `/v3/users/fb0de0b23cba42ac82df7e3bc1d359ce` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:43.198275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb0de0b23cba42ac82df7e3bc1d359ce)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:43.200381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:43.415469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb0de0b23cba42ac82df7e3bc1d359ce'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:43.416171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb0de0b23cba42ac82df7e3bc1d359ce'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:43.416791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb0de0b23cba42ac82df7e3bc1d359ce'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:43.424591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb0de0b23cba42ac82df7e3bc1d359ce'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:43.438719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb0de0b23cba42ac82df7e3bc1d359ce'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:43.517602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1031/2036] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:43 2022] DELETE /identity/v3/users/fb0de0b23cba42ac82df7e3bc1d359ce => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:43.522196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd178-335e-499d-83e8-1844769159e7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:43.522830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd178-335e-499d-83e8-1844769159e7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:43.523331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dd178-335e-499d-83e8-1844769159e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:43.541495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-864dd178-335e-499d-83e8-1844769159e7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:43.542706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-864dd178-335e-499d-83e8-1844769159e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:43.600432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1006/2037] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:43.609970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:43.611408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:43.668288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a0002-dc23-4164-851d-258c58693d0a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:43.671871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:43.672515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:43.672797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:43.673073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:43.682546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:43.686532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:43.693362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1032/2038] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:43.924279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:44.342674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd178-335e-499d-83e8-1844769159e7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:44.344583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-864dd178-335e-499d-83e8-1844769159e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:44.359933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dd178-335e-499d-83e8-1844769159e7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:44.373663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:44.374941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:44.381098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:44.381234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] PATH_INFO: `/v3/projects/7f3d10aef6a043f298de646de4e5bdc5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:44.382693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f3d10aef6a043f298de646de4e5bdc5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:44.385329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:44.501315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f3d10aef6a043f298de646de4e5bdc5', 'request_id': 'req-7e7f0f8c-4d87-42be-958b-168cba788fae'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.507534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f3d10aef6a043f298de646de4e5bdc5', 'request_id': 'req-7e7f0f8c-4d87-42be-958b-168cba788fae'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.551111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f3d10aef6a043f298de646de4e5bdc5', 'request_id': 'req-7e7f0f8c-4d87-42be-958b-168cba788fae'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.562730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] The token cache is being invalidate because project 7f3d10aef6a043f298de646de4e5bdc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:44.563023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.563793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.565650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1007/2039] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:44 2022] DELETE /identity/v3/projects/7f3d10aef6a043f298de646de4e5bdc5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:44.569472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:44.579974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1827bf-b145-4ec6-ba7b-ac5c6defa52c service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:44.639520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:44.640437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:44.640722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:44.641008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] PATH_INFO: `/v3/users/13dd6c6d512649a6a8f7af3cceafde36` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:44.642280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] RBAC: Authorizing `identity:delete_user(user_id=13dd6c6d512649a6a8f7af3cceafde36)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:44.645010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:44.851335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13dd6c6d512649a6a8f7af3cceafde36'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.852091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13dd6c6d512649a6a8f7af3cceafde36'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.852706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13dd6c6d512649a6a8f7af3cceafde36'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.863429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13dd6c6d512649a6a8f7af3cceafde36'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:44.864684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:44.879203 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8e13d8e0-4bbc-49e7-a17b-5add106c601b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13dd6c6d512649a6a8f7af3cceafde36'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.003530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1033/2040] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:44 2022] DELETE /identity/v3/users/13dd6c6d512649a6a8f7af3cceafde36 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:45.484221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:45.485851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:45.500647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f0f8c-4d87-42be-958b-168cba788fae admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:45.583805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:45.584992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:45.585553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:45.585833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] PATH_INFO: `/v3/projects/35575fc0794c421a978ed24ac910629d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:45.592516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=35575fc0794c421a978ed24ac910629d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:45.594926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:45.701744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:45.723439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35575fc0794c421a978ed24ac910629d', 'request_id': 'req-4a4dcea6-48cb-4dc9-adec-d358952646ce'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.729605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35575fc0794c421a978ed24ac910629d', 'request_id': 'req-4a4dcea6-48cb-4dc9-adec-d358952646ce'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.814576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35575fc0794c421a978ed24ac910629d', 'request_id': 'req-4a4dcea6-48cb-4dc9-adec-d358952646ce'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.830003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] The token cache is being invalidate because project 35575fc0794c421a978ed24ac910629d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:45.830602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.832014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4a4dcea6-48cb-4dc9-adec-d358952646ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:45.833830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1008/2041] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:45 2022] DELETE /identity/v3/projects/35575fc0794c421a978ed24ac910629d => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:45.839403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36927-973b-481d-a864-986c12bc8afa None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:45.839941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36927-973b-481d-a864-986c12bc8afa None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:45.840093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e36927-973b-481d-a864-986c12bc8afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:45.865835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-66e36927-973b-481d-a864-986c12bc8afa None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:45.867281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-66e36927-973b-481d-a864-986c12bc8afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:45.944937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1034/2042] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:45.953901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:45.954195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:45.954477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:45.974858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:45.976117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:45.984598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1009/2043] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:45.989527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36927-973b-481d-a864-986c12bc8afa None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:45.999958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e36927-973b-481d-a864-986c12bc8afa None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.005626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.006328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.006618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.006918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.007782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:46.008114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.013787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.023459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1035/2044] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:10:46.028175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.041417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7662e-b899-4cb8-b246-e30918a4fe97 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.054413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.055106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.055395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.055704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.056444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.058396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.152224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1010/2045] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:46 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:46.156388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.169142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d5186-4ed5-462b-a06e-18e5f2a83dfe admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.232677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.234039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.234560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.235002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.235890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.239063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.366888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.369954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1036/2046] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:46 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:46.385109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0dfbef-cbfc-4870-8eeb-c5c0878ccb91 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.390728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.391411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.391763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.392053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.392793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.394560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.408215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1011/2047] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:46.415145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.430620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705375a-c1be-400f-a3e7-3bc84cd32d53 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.435509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.436247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.436784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.443217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.443217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.443217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51de65-914f-45f6-a385-3ee257387f70 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.451859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1037/2048] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:46.456179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.470978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30144b6f-7912-414d-ab62-990dad58a794 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.478145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.479096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.479381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.479707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] PATH_INFO: `/v3/projects/b9add1a289494e34839e470a249e5ab0/users/0acebaa2a2e34dcf8d4394d8fd68c79b/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.497697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9add1a289494e34839e470a249e5ab0, user_id=0acebaa2a2e34dcf8d4394d8fd68c79b, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.500410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.673359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1012/2049] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:46 2022] PUT /identity/v3/projects/b9add1a289494e34839e470a249e5ab0/users/0acebaa2a2e34dcf8d4394d8fd68c79b/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:46.685642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.685944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.686235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.728916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] MFA Rules not processed for user `0acebaa2a2e34dcf8d4394d8fd68c79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:46.729490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:46.765081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:46.814715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1038/2050] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:46.819674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:46.897216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc88044-2aec-4ba5-a9e5-f328e371a249 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:46.903958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:46.904817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:46.905108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:46.905388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:46.906117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:46.908374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:46.987298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1013/2051] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:46 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:46.991995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.008175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda593a-d74c-4039-ac01-03f5ea480f81 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.077405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.078091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.078384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.078667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.079365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.081380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.204617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1039/2052] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:46 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:47.211158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.224497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c30c9fe-4b01-4893-9bca-a58cd6c6e597 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.229859 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.230804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.231145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.231493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.232721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.234783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.248840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1014/2053] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:47.257189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.269914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c243e-3fdb-438a-9391-c518f059fca2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.276112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.277437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.277728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.278351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] PATH_INFO: `/v3/projects/ad82921a760442069aed2a65212f0bf7/users/57fa5a13f2d24be5a86197d8cf192f21/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.301604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad82921a760442069aed2a65212f0bf7, user_id=57fa5a13f2d24be5a86197d8cf192f21, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.304515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.377995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1040/2054] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:47 2022] PUT /identity/v3/projects/ad82921a760442069aed2a65212f0bf7/users/57fa5a13f2d24be5a86197d8cf192f21/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:47.382271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.394327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf85aca-db24-4ec6-90db-766499c0273d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.416037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:47.468376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.469068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.469356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.469640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.470985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.473356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bff2fb-f75b-4823-9533-7923bd9434ad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.491110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1015/2055] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:47.495822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.509157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9eb3a8-7853-4fe1-84d1-c3c60e10e6e8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.516245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.517695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.517695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.518265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] PATH_INFO: `/v3/projects/ad82921a760442069aed2a65212f0bf7/users/57fa5a13f2d24be5a86197d8cf192f21/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.524442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad82921a760442069aed2a65212f0bf7, user_id=57fa5a13f2d24be5a86197d8cf192f21, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.527161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.541454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1041/2056] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:47 2022] PUT /identity/v3/projects/ad82921a760442069aed2a65212f0bf7/users/57fa5a13f2d24be5a86197d8cf192f21/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:47.552088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.553266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.553266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.584494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] MFA Rules not processed for user `57fa5a13f2d24be5a86197d8cf192f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:47.585718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:47.668641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1016/2057] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:47.677139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:47.679171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:47.752897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864e85a-a407-4475-b45b-60790539c508 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:47.760299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:47.760981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:47.761301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:47.761582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:47.772959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:47.774420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:47.785908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1042/2058] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:48.907080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:48.917930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29c8d-006e-45da-9752-61a2ff4473b9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:48.922722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fa5a13f2d24be5a86197d8cf192f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad82921a760442069aed2a65212f0bf7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:48.924132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:48.924132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:48.924132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:48.924735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:48.925745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:48.928660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:48.943179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1017/2059] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:48.947266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:48.957536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0cae42-5f96-48a0-a326-ef3910cec5fe service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:48.962578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fa5a13f2d24be5a86197d8cf192f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad82921a760442069aed2a65212f0bf7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:48.963327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:48.963646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:48.963930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:48.964646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:48.966685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:49.115516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1043/2060] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:48 2022] POST /identity/v3/projects => generated 354 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:49.122002 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:49.139041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074c4d0-ea3c-4d6c-9418-4f2fa0aa7d9c tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:49.258041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fa5a13f2d24be5a86197d8cf192f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad82921a760442069aed2a65212f0bf7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:49.258041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:49.258041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:49.258790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:49.258790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:49.258790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:49.259426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:49.289254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1018/2061] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:10:49.329568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:49.341157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:49.348797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abcdd3-5bf5-4cca-a1bd-c427a25ed220 tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:49.353909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57fa5a13f2d24be5a86197d8cf192f21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad82921a760442069aed2a65212f0bf7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:49.354823 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:49.355115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:49.355400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] PATH_INFO: `/v3/projects/d381a6b5fd8e4c25992828e41e3fac79` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:49.356632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d381a6b5fd8e4c25992828e41e3fac79)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:49.358726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:49.523745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd381a6b5fd8e4c25992828e41e3fac79', 'request_id': 'req-116926dd-98f6-49c0-b4c3-89f47736475a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:49.529925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd381a6b5fd8e4c25992828e41e3fac79', 'request_id': 'req-116926dd-98f6-49c0-b4c3-89f47736475a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:49.609976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd381a6b5fd8e4c25992828e41e3fac79', 'request_id': 'req-116926dd-98f6-49c0-b4c3-89f47736475a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:49.632439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] The token cache is being invalidate because project d381a6b5fd8e4c25992828e41e3fac79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:49.632761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:49.633831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:49.639223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1044/2062] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:49 2022] DELETE /identity/v3/projects/d381a6b5fd8e4c25992828e41e3fac79 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:49.947846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:49.949783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:49.984443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:50.026346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5353be-949e-4076-b4ed-b163bd0294dc tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:50.083699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:50.084603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.084921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.085202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] PATH_INFO: `/v3/users/c669b834d35c4822ac0602155b3007bc` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.086696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c669b834d35c4822ac0602155b3007bc)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:50.088995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:50.278957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c669b834d35c4822ac0602155b3007bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.292234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c669b834d35c4822ac0602155b3007bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.368333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c669b834d35c4822ac0602155b3007bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.376411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c669b834d35c4822ac0602155b3007bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.377107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c669b834d35c4822ac0602155b3007bc'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.383597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1019/2063] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:49 2022] DELETE /identity/v3/users/c669b834d35c4822ac0602155b3007bc => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:50.388988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:50.390591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:50.404482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116926dd-98f6-49c0-b4c3-89f47736475a tempest-VolumeQuotaClassesTest-1362597576 tempest-VolumeQuotaClassesTest-1362597576-project-admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:50.493716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:50.494905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.494905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.495341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] PATH_INFO: `/v3/users/0acebaa2a2e34dcf8d4394d8fd68c79b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.496871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0acebaa2a2e34dcf8d4394d8fd68c79b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:50.498756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:50.675630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0acebaa2a2e34dcf8d4394d8fd68c79b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.676300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0acebaa2a2e34dcf8d4394d8fd68c79b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.676906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0acebaa2a2e34dcf8d4394d8fd68c79b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.686898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0acebaa2a2e34dcf8d4394d8fd68c79b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.704344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ee46723d-e422-4abb-91ad-6499674da438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0acebaa2a2e34dcf8d4394d8fd68c79b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.713344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:50.714795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:50.730535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c314535-30c0-42b0-9ced-f9f4d67f42a6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:50.741481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:50.742388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.742678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.742959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] PATH_INFO: `/v3/projects/3cb92a533e7148d8ab3679644bd353e9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.744205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb92a533e7148d8ab3679644bd353e9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:50.746128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:50.781958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1045/2064] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:50 2022] DELETE /identity/v3/users/0acebaa2a2e34dcf8d4394d8fd68c79b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:50.786311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.786612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.786924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.794401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:50.805519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:50.806730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:50.848284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:50.849471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb92a533e7148d8ab3679644bd353e9', 'request_id': 'req-21888b4c-cb90-4803-83b1-f4212e1a04b5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.854978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb92a533e7148d8ab3679644bd353e9', 'request_id': 'req-21888b4c-cb90-4803-83b1-f4212e1a04b5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.870382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1046/2065] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:50.880593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:50.881984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:50.922573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb92a533e7148d8ab3679644bd353e9', 'request_id': 'req-21888b4c-cb90-4803-83b1-f4212e1a04b5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.934090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] The token cache is being invalidate because project 3cb92a533e7148d8ab3679644bd353e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:50.934380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.935013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-21888b4c-cb90-4803-83b1-f4212e1a04b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:50.936589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1020/2066] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:50 2022] DELETE /identity/v3/projects/3cb92a533e7148d8ab3679644bd353e9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:50.940062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82930d4a-72fd-4bde-a302-443bbc258d43 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:50.942635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed7b-7fea-4c49-a562-9c918944e3f1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.942928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed7b-7fea-4c49-a562-9c918944e3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.943228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21ed7b-7fea-4c49-a562-9c918944e3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.967350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8b21ed7b-7fea-4c49-a562-9c918944e3f1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:50.968606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8b21ed7b-7fea-4c49-a562-9c918944e3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:50.989806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:50.990460 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:50.990751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:50.991049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:50.993021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:51.028975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1021/2067] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:51.037888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.038411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.039899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.059029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:51.060400 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:51.068517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.070043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.070617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1022/2068] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:10:51.074729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.080667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1047/2069] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:51.084930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fab0a-9a56-4ec1-9782-3f0214588611 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.089537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.090209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.090637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.090924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.091683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:51.095510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.095510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.106630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1023/2070] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:10:51.111372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.124256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995470b4-7590-4227-aef6-d0a672c4f896 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.129687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.130338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.130622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.130899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.131629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.133637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.142333 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:51.254223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1048/2071] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:51 2022] POST /identity/v3/projects => generated 355 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:51.255362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.265818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf48c57-23a7-4f38-b610-059f083bd092 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.341624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.342593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.342990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.343727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.344293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.346288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.434941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1024/2072] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:51 2022] POST /identity/v3/users => generated 278 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:51.437845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.451275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4161904c-0b1c-46d2-b69f-4400d5ba5d18 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.457757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.458483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.458952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.463504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.463504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.463504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.478858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1049/2073] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:51.483837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.495877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d6d90-9cda-4859-b10c-ad9e1dc704a8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.500646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.501324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.501614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.501905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.502649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.504353 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2cfd3-ba13-4f30-96ab-f89f19a4baa1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.520839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1025/2074] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:51.526025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.555787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51250bb7-4876-461e-acba-b67ca3ab65e5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.561598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.562941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.563365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.563680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] PATH_INFO: `/v3/projects/0546c981b5cb41198a0e97670610e6e1/users/b3504e171a5747aead6489a24037edca/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.590298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0546c981b5cb41198a0e97670610e6e1, user_id=b3504e171a5747aead6489a24037edca, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:51.593023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:51.694904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1050/2075] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:51 2022] PUT /identity/v3/projects/0546c981b5cb41198a0e97670610e6e1/users/b3504e171a5747aead6489a24037edca/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:51.710418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.711498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.711720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.772818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] MFA Rules not processed for user `b3504e171a5747aead6489a24037edca`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:51.775863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:51.824550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:51.836588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.845399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:51.914249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1026/2076] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:51 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:51.915193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:51.990620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec5c81-8763-4e2a-9d61-cae3c000a776 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:51.995616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:51.996502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:51.996777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:51.997056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] PATH_INFO: `/v3/projects/b9add1a289494e34839e470a249e5ab0` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:51.998261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9add1a289494e34839e470a249e5ab0)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.000200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.021182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df5e5-a69f-4f19-a427-e1b9fabbd0dc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.026599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.027278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.027609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.027881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.031672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.031672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.142896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9add1a289494e34839e470a249e5ab0', 'request_id': 'req-82531f23-ecd4-44ed-9350-cef3a2cc2789'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.148601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9add1a289494e34839e470a249e5ab0', 'request_id': 'req-82531f23-ecd4-44ed-9350-cef3a2cc2789'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.233508 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1027/2077] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:51 2022] POST /identity/v3/projects => generated 357 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:52.236998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.248038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9add1a289494e34839e470a249e5ab0', 'request_id': 'req-82531f23-ecd4-44ed-9350-cef3a2cc2789'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.261147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] The token cache is being invalidate because project b9add1a289494e34839e470a249e5ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:52.261436 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.262416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.264353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1051/2078] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:51 2022] DELETE /identity/v3/projects/b9add1a289494e34839e470a249e5ab0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:52.268046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.270204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:52.310837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56146162-b44e-42f6-ae6a-780d7b4ccd85 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.319608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:52.320563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.322017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.322529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.323016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.324425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.329310 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.338165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82531f23-ecd4-44ed-9350-cef3a2cc2789 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.344291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.345995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.345995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.345995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] PATH_INFO: `/v3/users/57fa5a13f2d24be5a86197d8cf192f21` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.347579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=57fa5a13f2d24be5a86197d8cf192f21)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.349515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.430336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1028/2079] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:52 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:52.434161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.435854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:52.448393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c6ea1-97ca-4196-b58f-aab84f638910 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.453308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.453972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.454264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.454925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.455313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.457849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.468533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1029/2080] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:52.473236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.483176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b8518-02a5-4f98-95e5-dda696b3b711 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.489109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.489924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.490211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.490485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] PATH_INFO: `/v3/projects/03e3a1c101ad41698765f060682d5594/users/e3ddb7bea0264f8a9729a51360482090/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.505444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e3a1c101ad41698765f060682d5594, user_id=e3ddb7bea0264f8a9729a51360482090, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.508128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.525071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57fa5a13f2d24be5a86197d8cf192f21'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.525749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57fa5a13f2d24be5a86197d8cf192f21'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.526379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57fa5a13f2d24be5a86197d8cf192f21'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.533462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57fa5a13f2d24be5a86197d8cf192f21'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.547443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57fa5a13f2d24be5a86197d8cf192f21'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:52.597538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1030/2081] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:52 2022] PUT /identity/v3/projects/03e3a1c101ad41698765f060682d5594/users/e3ddb7bea0264f8a9729a51360482090/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:52.601470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.603056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:52.608960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:52.619855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1052/2082] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:10:52 2022] DELETE /identity/v3/users/57fa5a13f2d24be5a86197d8cf192f21 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:52.668267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8de0d-f51c-4632-890b-b78c56609ec8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.732242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.732926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.733219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.733506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.734238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.736043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c225385-94fb-4a59-9724-30be57f11c17 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.747255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1031/2083] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:10:52.751534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.761979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709b390-45f4-4c9e-a98c-085269f53a2e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:52.766604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:52.767483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.767795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.768078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] PATH_INFO: `/v3/projects/03e3a1c101ad41698765f060682d5594/users/e3ddb7bea0264f8a9729a51360482090/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.770623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e3a1c101ad41698765f060682d5594, user_id=e3ddb7bea0264f8a9729a51360482090, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:52.773288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:52.783570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1053/2084] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:52 2022] PUT /identity/v3/projects/03e3a1c101ad41698765f060682d5594/users/e3ddb7bea0264f8a9729a51360482090/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:52.794255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:52.794554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:52.794839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:52.823338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] MFA Rules not processed for user `e3ddb7bea0264f8a9729a51360482090`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:52.824740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:52.913054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1032/2085] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:52 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:52.924724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:52.926995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:52.995929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6f49-8d25-44af-98e1-7ccabacfad7a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.000586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.001171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.001626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.002033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.013330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.014834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.026668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1054/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:52 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:53.070201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.071718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:53.118325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:53.183028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3249c-ff2f-4728-a85c-49f66d1781ef None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.190339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.192292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.192578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.192860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] PATH_INFO: `/v3/projects/ad82921a760442069aed2a65212f0bf7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.194712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad82921a760442069aed2a65212f0bf7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.197025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.244838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.246738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:53.262038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60868520-418c-44a0-94af-a11ae3202a0c service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.266787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.267433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.267751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.268032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.270748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:53.329887 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:53.334346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad82921a760442069aed2a65212f0bf7', 'request_id': 'req-4b290d8e-bf5d-4c76-b601-43952fb93c63'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:53.339944 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad82921a760442069aed2a65212f0bf7', 'request_id': 'req-4b290d8e-bf5d-4c76-b601-43952fb93c63'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:53.341212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.342650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a0dc1-c0d9-473f-8a25-2597253e666f service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.352394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1055/2087] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:53 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:53.430658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad82921a760442069aed2a65212f0bf7', 'request_id': 'req-4b290d8e-bf5d-4c76-b601-43952fb93c63'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:53.443004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] The token cache is being invalidate because project ad82921a760442069aed2a65212f0bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:10:53.443297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:53.443951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b290d8e-bf5d-4c76-b601-43952fb93c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:10:53.445516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1033/2088] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:10:53 2022] DELETE /identity/v3/projects/ad82921a760442069aed2a65212f0bf7 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:10:53.450504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.450801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.451087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.471386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:53.473398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:53.537694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1056/2089] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:53.545485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.545780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.546062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.564215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:53.565410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:53.578156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1034/2090] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:53.583390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.595740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6a69b6-9185-4eb0-bc9a-284796b4d61f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.601564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.602412 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.602718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.603004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.604072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:10:53.604440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.606130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.622398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1057/2091] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:10:53.623592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.633694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81bddf-64ca-4089-afad-bd5b77ce0d48 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.638690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.639339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.639648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.639926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.640620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.642699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.718810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1035/2092] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:53 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:53.723260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.737871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eadbcb-a62a-4901-9b27-1b28fcaf7e6b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.812720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.813488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.813984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.814388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.816187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.818878 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.922723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1058/2093] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:53 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:53.927364 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.938741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce04f-ab35-4ca8-bef5-5872608d2ebc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.944072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.944837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.945195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.945543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.946314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.948725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:53.959682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1036/2094] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:53.963868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:53.978230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8a9cf-ffa6-4f69-80d3-9b85ee2b830e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:53.983245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:53.984004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:53.984286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:53.984563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:53.985293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:53.986939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afe0b7b-7b10-44cf-9912-d3d9c865f584 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.003607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1059/2095] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:54.008093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.019637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66daf01e-29cc-4a3f-b2d4-52533be757d9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.024388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.025271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.025559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.025842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] PATH_INFO: `/v3/projects/8601c1da7ab04f228e3783e7652fb634/users/27dd91a0746a4703ab0317e815be9a55/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.043207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8601c1da7ab04f228e3783e7652fb634, user_id=27dd91a0746a4703ab0317e815be9a55, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.046406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.138806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1037/2096] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:54 2022] PUT /identity/v3/projects/8601c1da7ab04f228e3783e7652fb634/users/27dd91a0746a4703ab0317e815be9a55/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:54.149220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.149515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.149797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.177283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] MFA Rules not processed for user `27dd91a0746a4703ab0317e815be9a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:54.178566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:54.238648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:54.250973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1060/2097] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:54.255649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.321135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1abf7-66ea-4eb3-b149-2c634fe9aff4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.326155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.326825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.327115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.327390 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.328133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.330045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.334321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:54.445422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1038/2098] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:54 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:10:54.447896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.459317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e4a6a-a784-4d03-aa9f-dbea82cfff68 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.525464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.526138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.526458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.526742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.527432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.529485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.637815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1061/2099] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:54 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:54.641318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.652526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59f0df-78a0-475b-b9f5-8732f909e0ef admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.657289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.657986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.658275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.658555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.660001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.661602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.672316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1039/2100] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:54.677042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.687163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805f80e-737f-45d9-969d-78fa374cf561 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.692027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.692680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.692968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.693245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.693968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.695546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68458195-19bc-4064-a6cc-ee7bdcc7df8b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.705431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1062/2101] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:54.711283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:54.722771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f799653-818a-437b-aa78-3bfadfb706c2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:54.728493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:54.729407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.729686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.729973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] PATH_INFO: `/v3/projects/b3ae0df304e64976a4ec35bcf3978f86/users/1a9da810ce52455abc4c4e7be601d6d1/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.746198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ae0df304e64976a4ec35bcf3978f86, user_id=1a9da810ce52455abc4c4e7be601d6d1, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:54.748897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:54.819997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1040/2102] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:54 2022] PUT /identity/v3/projects/b3ae0df304e64976a4ec35bcf3978f86/users/1a9da810ce52455abc4c4e7be601d6d1/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:54.831717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:54.832100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:54.832476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:54.868528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] MFA Rules not processed for user `1a9da810ce52455abc4c4e7be601d6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:54.870310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:54.942795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1063/2103] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:54.947328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.012328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30118acd-0903-4d20-b33e-210da775c96a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.017875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.019136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.019428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.019761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.020476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.022406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.196831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1041/2104] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:10:54 2022] POST /identity/v3/projects => generated 377 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:55.200716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.211670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e71739-ba38-485b-b0ec-6bd6fbba0ed3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.265862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:55.273747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.274683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.275231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.275720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.276395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.286870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.351146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1064/2105] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:10:55 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:10:55.355092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.366255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b85fa-49c6-4777-a88e-f42942e7b12a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.373066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.373773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.374397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.374397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.375251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.376924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.389218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1042/2106] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:55.393634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.404170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a7c3e-6ddc-4097-9e65-b5b13a2725df admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.408918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.410383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.410673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.410952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] PATH_INFO: `/v3/projects/b547d7f811a143e7875c63ed3420ccf8/users/019f07364e12403e8e6d5f80783c3022/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.426133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547d7f811a143e7875c63ed3420ccf8, user_id=019f07364e12403e8e6d5f80783c3022, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.429350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.529038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1065/2107] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:55 2022] PUT /identity/v3/projects/b547d7f811a143e7875c63ed3420ccf8/users/019f07364e12403e8e6d5f80783c3022/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:55.533661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.545350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086c3bff-9bab-42cb-a6ea-e9b69b205020 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.610285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.610958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.611241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.611516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.612352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.613950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f45046-094a-44db-94eb-bfc6f994e754 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.624309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1043/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:10:55.629253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.640628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb17f-b495-49d5-9548-ed0efc273c36 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.646366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.647361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.647755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.648123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] PATH_INFO: `/v3/projects/b547d7f811a143e7875c63ed3420ccf8/users/019f07364e12403e8e6d5f80783c3022/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.650168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b547d7f811a143e7875c63ed3420ccf8, user_id=019f07364e12403e8e6d5f80783c3022, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.652826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.663248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1066/2109] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:10:55 2022] PUT /identity/v3/projects/b547d7f811a143e7875c63ed3420ccf8/users/019f07364e12403e8e6d5f80783c3022/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:10:55.673311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71c03-7125-4869-a704-858112833ba8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.673633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71c03-7125-4869-a704-858112833ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.673919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71c03-7125-4869-a704-858112833ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.700462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-88a71c03-7125-4869-a704-858112833ba8 None None] MFA Rules not processed for user `019f07364e12403e8e6d5f80783c3022`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:10:55.701606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-88a71c03-7125-4869-a704-858112833ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:55.710651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:10:55.772035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1044/2110] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:10:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:10:55.782933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:55.785306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:55.847189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634e55ca-e5e9-4d51-8865-a827255572fc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:55.851264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:55.853563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:55.853857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:55.854144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:55.865050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:55.866513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:55.876715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1067/2111] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:10:56.021697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71c03-7125-4869-a704-858112833ba8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:56.036810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71c03-7125-4869-a704-858112833ba8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:56.046030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:56.046030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:56.046030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:56.046030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:56.103271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:56.104752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:56.114331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1045/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:10:57.432401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:10:57.434748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:57.446225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be66b6-9aa9-40ae-9427-2d8e3c2b32fd service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:10:57.450537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:10:57.451710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:10:57.451710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:10:57.452040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:10:57.454065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:10:57.538540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:10:57.543936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffebcbf-35e3-4610-8cec-40bbdc767b8c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:10:57.552349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1068/2113] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:10:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:00.892662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:00.894749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:00.961999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f09129-d08a-473d-b670-e24fc13430b7 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:00.966453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:00.973359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:00.973359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:00.973359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] PATH_INFO: `/v3/users/54a1b0e9e3164d7c91fb973c11a0a515` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:00.973359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] RBAC: Authorizing `identity:delete_user(user_id=54a1b0e9e3164d7c91fb973c11a0a515)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:00.973359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:01.151564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:01.153453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54a1b0e9e3164d7c91fb973c11a0a515'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:01.165416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54a1b0e9e3164d7c91fb973c11a0a515'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:01.264870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54a1b0e9e3164d7c91fb973c11a0a515'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:01.272335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54a1b0e9e3164d7c91fb973c11a0a515'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:01.273007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54a1b0e9e3164d7c91fb973c11a0a515'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:01.279057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1046/2114] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:00 2022] DELETE /identity/v3/users/54a1b0e9e3164d7c91fb973c11a0a515 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:01.283895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:01.284392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:01.284623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:01.302915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:01.304127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:01.346501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:01.370239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1069/2115] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:01.380222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:01.386083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:01.441484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64dd10-6564-4ccf-be48-fc9963acf85e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:01.445433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:01.446142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:01.446433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:01.446709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:01.456236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:01.457906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:01.468156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1047/2116] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:01.816811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:01.818373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:01.830687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84de0e-8c2b-4ea7-a406-ad0927308b52 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:01.836041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:01.836919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:01.837321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:01.840732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] PATH_INFO: `/v3/users/27dd91a0746a4703ab0317e815be9a55` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:01.840732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dd91a0746a4703ab0317e815be9a55)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:01.840924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:01.895965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:01.898018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:01.931717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a3552-6ff3-4325-bf56-9446136abc52 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:01.937516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:01.938599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:01.938935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:01.939218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] PATH_INFO: `/v3/projects/d3f7cbc2eccd4208ae68458523045375` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:01.940435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f7cbc2eccd4208ae68458523045375)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:01.942841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.094455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f7cbc2eccd4208ae68458523045375', 'request_id': 'req-918b3782-255d-44ca-a14d-5c7c7d9effbb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.102103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f7cbc2eccd4208ae68458523045375', 'request_id': 'req-918b3782-255d-44ca-a14d-5c7c7d9effbb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.110297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dd91a0746a4703ab0317e815be9a55'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.111164 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dd91a0746a4703ab0317e815be9a55'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.117956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dd91a0746a4703ab0317e815be9a55'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.119976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dd91a0746a4703ab0317e815be9a55'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.134967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-81bc10d7-62ff-4367-9210-35519366af8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dd91a0746a4703ab0317e815be9a55'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.258911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f7cbc2eccd4208ae68458523045375', 'request_id': 'req-918b3782-255d-44ca-a14d-5c7c7d9effbb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.271255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] The token cache is being invalidate because project d3f7cbc2eccd4208ae68458523045375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:02.271541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.272216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-918b3782-255d-44ca-a14d-5c7c7d9effbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:02.273762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1048/2117] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:01 2022] DELETE /identity/v3/projects/d3f7cbc2eccd4208ae68458523045375 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:02.278587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db55b-56b0-4ce9-8f39-19db678bb3ad None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.278877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db55b-56b0-4ce9-8f39-19db678bb3ad None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.279156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199db55b-56b0-4ce9-8f39-19db678bb3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.297430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-199db55b-56b0-4ce9-8f39-19db678bb3ad None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:02.298779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-199db55b-56b0-4ce9-8f39-19db678bb3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:02.351831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1070/2118] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:01 2022] DELETE /identity/v3/users/27dd91a0746a4703ab0317e815be9a55 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:02.353769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.355608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:02.357734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.358066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.377634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1049/2119] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:02.385536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:02.385737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.386056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.386414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.387058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:02.418571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:02.420178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:02.462361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1071/2120] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:02.473090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.474956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:02.487860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1050/2121] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:02.489484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.498699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7576c-06cd-4146-8e43-01e7ced3a733 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.503570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.504824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.505296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.505666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.506395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:02.506705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.508418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.526599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1051/2122] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:02.527803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.536380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70714067-3637-438e-99e6-ce830bfbb079 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.538526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1aa73-962d-499a-b95c-06f790e52ffd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.540382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.541041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.541328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.541608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.544875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.545728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.546086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.546515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.547313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.549631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.553252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.554768 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.562850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:02.571229 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1072/2123] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:02.660431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1052/2124] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:02 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:02.665057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.676861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5382f0ec-ca20-458a-a084-25e29b4d5d87 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.736162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.736947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.737238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.737518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.738224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.741180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.866193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1073/2125] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:02 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:02.870233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.881205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ae6-2b7a-4eb8-9c74-1d388bae86f3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.885838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.887313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.887313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.887488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.888218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.889809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.901288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1053/2126] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:02.906941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.919118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045cc8d-87e1-46c6-beb3-8ae46dcd1fd8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.924357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.925031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.925318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.925599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.928375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.928826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae166b-1f80-472c-94f4-f09f103ce9e6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:02.939657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1074/2127] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:02.944860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:02.955120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539b425-7a1d-487c-990e-270f536c65f7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:02.961274 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:02.962238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:02.962529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:02.962882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] PATH_INFO: `/v3/projects/6a74af209324471795c15c7785d09056/users/0d88930ae012493892c8e14f36d6a034/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:02.980282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a74af209324471795c15c7785d09056, user_id=0d88930ae012493892c8e14f36d6a034, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:02.983547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:03.053432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1054/2128] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:02 2022] PUT /identity/v3/projects/6a74af209324471795c15c7785d09056/users/0d88930ae012493892c8e14f36d6a034/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:03.058515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:03.058864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:03.059098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:03.076536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:03.077740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:03.138719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1075/2129] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:03.148961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:03.150787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:03.174618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:03.176778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:03.189868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0a61f-8082-46d3-b736-651c491db9bc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:03.195099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:03.199072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:03.199072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:03.199072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] PATH_INFO: `/v3/projects/8601c1da7ab04f228e3783e7652fb634` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:03.199072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8601c1da7ab04f228e3783e7652fb634)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:03.199785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:03.217647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c860c-9cf4-4310-86ba-d4c9adccf1db admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:03.222629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:03.224000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:03.224398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:03.224840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:03.238333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:03.240452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:03.252800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1055/2130] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:03.359885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8601c1da7ab04f228e3783e7652fb634', 'request_id': 'req-fb335252-d45d-45c2-8298-a54a1784bc80'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.366151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8601c1da7ab04f228e3783e7652fb634', 'request_id': 'req-fb335252-d45d-45c2-8298-a54a1784bc80'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.607913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8601c1da7ab04f228e3783e7652fb634', 'request_id': 'req-fb335252-d45d-45c2-8298-a54a1784bc80'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.620216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] The token cache is being invalidate because project 8601c1da7ab04f228e3783e7652fb634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:03.620421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.621268 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.623518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1076/2131] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:03 2022] DELETE /identity/v3/projects/8601c1da7ab04f228e3783e7652fb634 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:03.627481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:03.638804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d67827-bafb-4d2f-b557-54036bb0b4d5 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:03.665280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:03.720676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:03.721862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:03.722152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:03.722745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] PATH_INFO: `/v3/users/1a9da810ce52455abc4c4e7be601d6d1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:03.724692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9da810ce52455abc4c4e7be601d6d1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:03.727696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:03.913387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9da810ce52455abc4c4e7be601d6d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:03.925287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9da810ce52455abc4c4e7be601d6d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.010218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9da810ce52455abc4c4e7be601d6d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.019925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9da810ce52455abc4c4e7be601d6d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.020740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-055242d3-cff2-4bec-88f0-9ce3cde5f2de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9da810ce52455abc4c4e7be601d6d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.029261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1056/2132] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:03 2022] DELETE /identity/v3/users/1a9da810ce52455abc4c4e7be601d6d1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:04.640701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:04.642236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:04.656912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:04.663709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb335252-d45d-45c2-8298-a54a1784bc80 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:04.722526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:04.724172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:04.724488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:04.724755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] PATH_INFO: `/v3/projects/b3ae0df304e64976a4ec35bcf3978f86` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:04.726215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ae0df304e64976a4ec35bcf3978f86)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:04.736061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:04.831862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:04.833078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:04.833558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:04.864326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ae0df304e64976a4ec35bcf3978f86', 'request_id': 'req-f8119aea-54fc-4e81-9cea-3b3e51377681'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.870356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ae0df304e64976a4ec35bcf3978f86', 'request_id': 'req-f8119aea-54fc-4e81-9cea-3b3e51377681'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.879222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] MFA Rules not processed for user `0d88930ae012493892c8e14f36d6a034`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:04.880638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:04.954864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ae0df304e64976a4ec35bcf3978f86', 'request_id': 'req-f8119aea-54fc-4e81-9cea-3b3e51377681'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.956495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1057/2133] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:04.970035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] The token cache is being invalidate because project b3ae0df304e64976a4ec35bcf3978f86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:04.970340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.971057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:04.975330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1077/2134] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:04 2022] DELETE /identity/v3/projects/b3ae0df304e64976a4ec35bcf3978f86 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:04.976779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:04.978325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:04.989899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:04.991519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:05.017343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:05.045728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550895b7-2a3c-47e2-a34b-0551014f2d85 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:05.049449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:05.050332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:05.050656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:05.053614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:05.055893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:05.068141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:05.073700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:05.081903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1058/2135] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:05.106771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119aea-54fc-4e81-9cea-3b3e51377681 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:05.112361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:05.113485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:05.113935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:05.114728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] PATH_INFO: `/v3/users/019f07364e12403e8e6d5f80783c3022` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:05.116704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019f07364e12403e8e6d5f80783c3022)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:05.119311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:05.326889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:05.337005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019f07364e12403e8e6d5f80783c3022'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:05.337814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019f07364e12403e8e6d5f80783c3022'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:05.338474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019f07364e12403e8e6d5f80783c3022'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:05.345649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019f07364e12403e8e6d5f80783c3022'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:05.357884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5530e2d7-cdd6-4762-a90e-ebd18ecd0022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019f07364e12403e8e6d5f80783c3022'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:05.442591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1078/2136] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:04 2022] DELETE /identity/v3/users/019f07364e12403e8e6d5f80783c3022 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:05.842689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:05.859366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dbb36-f24a-47bf-9506-6396ac001478 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:05.933056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:05.933925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:05.934213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:05.934491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] PATH_INFO: `/v3/projects/b547d7f811a143e7875c63ed3420ccf8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:05.935692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b547d7f811a143e7875c63ed3420ccf8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:05.937599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.031617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b547d7f811a143e7875c63ed3420ccf8', 'request_id': 'req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:06.038043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b547d7f811a143e7875c63ed3420ccf8', 'request_id': 'req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:06.082412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b547d7f811a143e7875c63ed3420ccf8', 'request_id': 'req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:06.096055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] The token cache is being invalidate because project b547d7f811a143e7875c63ed3420ccf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:06.096055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:06.096055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-35cf2cd9-3d2f-4e74-adfc-4d3e03b060e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:06.098193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1059/2137] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:05 2022] DELETE /identity/v3/projects/b547d7f811a143e7875c63ed3420ccf8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:06.104639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.105114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.105237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.125927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:06.127918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:06.191032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1079/2138] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:06.199581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.199909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.200193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.219903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:06.221116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:06.230260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1060/2139] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:06.234537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.245802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ac80f-421e-4dae-9754-d616719bbca3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.250987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.251484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.251801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.252074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.252807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:06.253119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.255166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.272153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1080/2140] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:06.273250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.291827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddc039-4360-44bc-a6e8-fbd37a3e858a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.297202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.302724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.302724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.302724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.302724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.302724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.404669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1061/2141] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:06 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:06.408655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.419754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb484-01e3-4c7a-a1be-65b6c48e4e52 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.480612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.481286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.481568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.481846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.482547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.484584 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.580849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1081/2142] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:06 2022] POST /identity/v3/users => generated 282 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:06.581921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.594381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360b77-2501-4c34-8568-ad40f1c293fd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.599643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.604085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.604085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.604085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.604085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.604085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.617441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1062/2143] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:06.621552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.633771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faaa9b-4274-4452-a30d-09957b6607bd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.638764 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.639500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.639808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.640087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.640814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.642398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391883ea-5558-4762-8d63-7ef0def18d63 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.654365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1082/2144] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:06.658542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:06.669563 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2722-f3f5-4fdb-a4a5-74571fb75be4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:06.676111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:06.679224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.679224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.679224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] PATH_INFO: `/v3/projects/37aa9863b7a4432c97debb5eb3a32f1e/users/e16aff8d5b7b4ebb85d301494c4589ac/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.701959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=37aa9863b7a4432c97debb5eb3a32f1e, user_id=e16aff8d5b7b4ebb85d301494c4589ac, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:06.701959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:06.814763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:06.820406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1063/2145] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:06 2022] PUT /identity/v3/projects/37aa9863b7a4432c97debb5eb3a32f1e/users/e16aff8d5b7b4ebb85d301494c4589ac/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:06.896264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617e3c-813b-497e-8696-cf606e0e36d7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:06.896500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617e3c-813b-497e-8696-cf606e0e36d7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:06.896787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8617e3c-813b-497e-8696-cf606e0e36d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:06.930321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f8617e3c-813b-497e-8696-cf606e0e36d7 None None] MFA Rules not processed for user `e16aff8d5b7b4ebb85d301494c4589ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:06.931626 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f8617e3c-813b-497e-8696-cf606e0e36d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:06.936813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:06.998634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1083/2146] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:07.010865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:07.012909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:07.072613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfddcdd-c522-4c06-978a-b763eee6ef0a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:07.076328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:07.076962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:07.077248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:07.077530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:07.086633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:07.089991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:07.097091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1064/2147] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:07.873900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2771b6-7082-4f14-884f-338dd6ba4c74 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:07.877002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2771b6-7082-4f14-884f-338dd6ba4c74 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:07.877002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2771b6-7082-4f14-884f-338dd6ba4c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:07.893860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1e2771b6-7082-4f14-884f-338dd6ba4c74 None None] MFA Rules not processed for user `0d88930ae012493892c8e14f36d6a034`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:07.895943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1e2771b6-7082-4f14-884f-338dd6ba4c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:07.953411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1084/2148] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:12.088422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:12.089882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:12.165553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5ef82-b44a-41e5-bc6d-296f28d06d22 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:12.171392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:12.172720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:12.173007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:12.173286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] PATH_INFO: `/v3/users/06d201f1ca1b4f27bc02c6038c94daf3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:12.174519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d201f1ca1b4f27bc02c6038c94daf3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:12.176639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:12.465099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d201f1ca1b4f27bc02c6038c94daf3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:12.484438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d201f1ca1b4f27bc02c6038c94daf3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:12.584490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d201f1ca1b4f27bc02c6038c94daf3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:12.594881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d201f1ca1b4f27bc02c6038c94daf3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:12.594881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d201f1ca1b4f27bc02c6038c94daf3'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:12.604380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1065/2149] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:12 2022] DELETE /identity/v3/users/06d201f1ca1b4f27bc02c6038c94daf3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:12.608836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:12.609286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:12.609473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:12.627949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:12.629149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:12.688881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1085/2150] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:12.698896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:12.700393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:12.728105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:12.759988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b152ac-4a9a-424c-97fc-4c770f6d29bf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:12.764250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:12.764943 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:12.765233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:12.765514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:12.775201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:12.776844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c9f3a-031d-4ead-b255-74d5448cf5cc service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:12.788233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1066/2151] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:13.346279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:13.353212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:13.364941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571579c-d9d2-4238-9123-fc797cf19baf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:13.385291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:13.385291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:13.385291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:13.385291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] PATH_INFO: `/v3/projects/a0856375c86440b1b35d22ef85731e46` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:13.385674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0856375c86440b1b35d22ef85731e46)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:13.385674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:13.555252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:13.556645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0856375c86440b1b35d22ef85731e46', 'request_id': 'req-aba1037c-3a03-468a-a7f4-d585ae25fd85'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:13.563835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0856375c86440b1b35d22ef85731e46', 'request_id': 'req-aba1037c-3a03-468a-a7f4-d585ae25fd85'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:13.663360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0856375c86440b1b35d22ef85731e46', 'request_id': 'req-aba1037c-3a03-468a-a7f4-d585ae25fd85'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:13.678645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] The token cache is being invalidate because project a0856375c86440b1b35d22ef85731e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:13.678973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:13.687148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-aba1037c-3a03-468a-a7f4-d585ae25fd85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:13.687148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1086/2152] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:13 2022] DELETE /identity/v3/projects/a0856375c86440b1b35d22ef85731e46 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:13.688012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749388-4291-4bea-abb9-f4737649a978 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:13.688464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749388-4291-4bea-abb9-f4737649a978 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:13.688580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749388-4291-4bea-abb9-f4737649a978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:13.715093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-70749388-4291-4bea-abb9-f4737649a978 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:13.716678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-70749388-4291-4bea-abb9-f4737649a978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:13.802606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1067/2153] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:13.804518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:13.804811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:13.805096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:13.838724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:13.840331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:13.851960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1087/2154] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:13.853560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749388-4291-4bea-abb9-f4737649a978 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:13.866112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749388-4291-4bea-abb9-f4737649a978 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:13.871467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:13.872189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:13.872718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:13.873011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:13.873763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:13.874079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:13.875825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:13.891092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1068/2155] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:11:13.903886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:13.914553 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea50e9-b653-4524-a446-73262e29ef08 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:13.919545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:13.920468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:13.920610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:13.921093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:13.921807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:13.923820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.055160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1088/2156] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:13 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:14.056642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:14.067983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81561a7-8b60-41c5-90f5-fe96cceab2be admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:14.134183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:14.135337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.136613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.136778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.138076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:14.141870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.293670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1069/2157] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:14 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:14.297754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:14.308893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ddb013-9773-4537-9c59-e68a869c6948 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:14.313506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:14.314262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.314617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.314990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.315751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:14.317548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.330765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1089/2158] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:14.332038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:14.342228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742580-2a9d-4632-8cfc-02fd98c10822 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:14.346781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:14.348719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.354754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.354754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.354754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:14.356127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695eb77-233a-454e-91a3-30a91821a5cc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.372747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1070/2159] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:14.383607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:14.384618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21557d-8c56-4cd3-af84-de24157c1b12 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:14.391365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:14.392591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.393105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.393486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] PATH_INFO: `/v3/projects/630fd5df6ab94946af76681a680751aa/users/96e08dbcaece49c383885fbad7cda049/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.416126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630fd5df6ab94946af76681a680751aa, user_id=96e08dbcaece49c383885fbad7cda049, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:14.418959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.510842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1090/2160] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:14 2022] PUT /identity/v3/projects/630fd5df6ab94946af76681a680751aa/users/96e08dbcaece49c383885fbad7cda049/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:14.524062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.524362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.524651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.551841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] MFA Rules not processed for user `96e08dbcaece49c383885fbad7cda049`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:14.553061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:14.571374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:14.619115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1071/2161] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:14.642170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:14.643966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:14.706276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c5bba-65c1-4d05-b0a7-d503daa7ffd9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:14.710988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:14.711676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:14.711972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:14.712256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:14.721188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:14.723435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f803b0cf-dc58-442e-950f-fe6a6bc0f709 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:14.733016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1091/2162] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:17.090128 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:17.091773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:17.166411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b197b1ad-036f-4d8f-b22a-5a25129270ea None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:17.171771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:17.172834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:17.173266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:17.173713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] PATH_INFO: `/v3/users/b3504e171a5747aead6489a24037edca` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:17.175266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3504e171a5747aead6489a24037edca)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:17.178007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:17.353725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3504e171a5747aead6489a24037edca'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:17.366848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3504e171a5747aead6489a24037edca'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:17.459228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3504e171a5747aead6489a24037edca'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:17.466865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3504e171a5747aead6489a24037edca'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:17.467616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3504e171a5747aead6489a24037edca'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:17.474661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1072/2163] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:17 2022] DELETE /identity/v3/users/b3504e171a5747aead6489a24037edca => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:17.479367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:17.479849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:17.480144 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:17.498343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:17.499544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:17.561616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1092/2164] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:17.571731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:17.573166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:17.620143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:17.635296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d484d-d4dc-4cd5-9ca3-6059bbda2a41 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:17.639383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:17.639980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:17.640263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:17.640539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:17.651897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:17.653469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:17.665001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1073/2165] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:18.076947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:18.078447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:18.091613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4fc66-74da-49fd-9c6c-3c6f35eb1c51 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:18.096566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:18.097453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:18.097793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:18.098076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] PATH_INFO: `/v3/projects/0546c981b5cb41198a0e97670610e6e1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:18.099527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0546c981b5cb41198a0e97670610e6e1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:18.104219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:18.114405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:18.219049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0546c981b5cb41198a0e97670610e6e1', 'request_id': 'req-d5fa16bc-97b9-478b-82e4-7c3219674492'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.224505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0546c981b5cb41198a0e97670610e6e1', 'request_id': 'req-d5fa16bc-97b9-478b-82e4-7c3219674492'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.309791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0546c981b5cb41198a0e97670610e6e1', 'request_id': 'req-d5fa16bc-97b9-478b-82e4-7c3219674492'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.323977 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] The token cache is being invalidate because project 0546c981b5cb41198a0e97670610e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:18.324272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.325014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.330464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:18.331446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1093/2166] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:18 2022] DELETE /identity/v3/projects/0546c981b5cb41198a0e97670610e6e1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:18.340681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068746e7-0d4c-4fcb-b0e9-8bf2f46c44b1 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:18.351845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:18.353388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:18.414255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:18.415932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:18.416222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:18.416505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] PATH_INFO: `/v3/users/e3ddb7bea0264f8a9729a51360482090` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:18.419874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ddb7bea0264f8a9729a51360482090)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:18.424219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:18.443181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa16bc-97b9-478b-82e4-7c3219674492 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:18.449585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:18.450667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:18.451062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:18.451452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] PATH_INFO: `/v3/users/96e08dbcaece49c383885fbad7cda049` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:18.453150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e08dbcaece49c383885fbad7cda049)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:18.455367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:18.643394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ddb7bea0264f8a9729a51360482090'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.661666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ddb7bea0264f8a9729a51360482090'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.674526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e08dbcaece49c383885fbad7cda049'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.676616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e08dbcaece49c383885fbad7cda049'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.677313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e08dbcaece49c383885fbad7cda049'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.688264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e08dbcaece49c383885fbad7cda049'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.701804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e08dbcaece49c383885fbad7cda049'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.749552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ddb7bea0264f8a9729a51360482090'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.757249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ddb7bea0264f8a9729a51360482090'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.758113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1e6188d1-3c1c-41c2-a1e2-0c09ffc6df4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ddb7bea0264f8a9729a51360482090'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:18.764856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1074/2167] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:18 2022] DELETE /identity/v3/users/e3ddb7bea0264f8a9729a51360482090 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:18.841305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1094/2168] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:18 2022] DELETE /identity/v3/users/96e08dbcaece49c383885fbad7cda049 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:18.845806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:18.846319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:18.846424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:18.865572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:18.866790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:18.927355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1075/2169] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:18.937100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:18.938531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:18.959873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:19.007633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e2bb-4998-4711-af61-b92658b3ec70 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:19.012482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:19.019931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.019931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.019931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.026456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:19.028227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8dca1-e9a6-493b-93c9-cebd6d8f4c85 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:19.045742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1095/2170] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:19.221322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:19.223735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:19.234303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:19.242801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846b4ad9-8444-4462-a7b5-ae0762c63975 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:19.259244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:19.260541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.260541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.261181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] PATH_INFO: `/v3/projects/03e3a1c101ad41698765f060682d5594` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.262298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e3a1c101ad41698765f060682d5594)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:19.264279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:19.407617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e3a1c101ad41698765f060682d5594', 'request_id': 'req-40e8aa1f-9acb-4502-a713-d5b24aa191b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.414264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e3a1c101ad41698765f060682d5594', 'request_id': 'req-40e8aa1f-9acb-4502-a713-d5b24aa191b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.504162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e3a1c101ad41698765f060682d5594', 'request_id': 'req-40e8aa1f-9acb-4502-a713-d5b24aa191b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.538753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] The token cache is being invalidate because project 03e3a1c101ad41698765f060682d5594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:19.539223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.543898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.549762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1076/2171] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:19 2022] DELETE /identity/v3/projects/03e3a1c101ad41698765f060682d5594 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:19.555151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326478-7008-44e4-860c-24488f97bd8e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.555945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326478-7008-44e4-860c-24488f97bd8e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.556435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326478-7008-44e4-860c-24488f97bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.578164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:19.579778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:19.624851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f5326478-7008-44e4-860c-24488f97bd8e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:19.629795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f5326478-7008-44e4-860c-24488f97bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:19.703751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8aa1f-9acb-4502-a713-d5b24aa191b2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:19.710336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:19.711231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.711522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.712989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] PATH_INFO: `/v3/projects/630fd5df6ab94946af76681a680751aa` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.714771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=630fd5df6ab94946af76681a680751aa)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:19.717103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:19.761914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1096/2172] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:19.770272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.770866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.771294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.789901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:19.791143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:19.800890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1097/2173] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:19.806145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:19.815500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2258a6-9e31-4279-a822-4e1a501454cb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:19.820958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:19.821691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.821985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.822265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.823000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:19.823313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:19.824956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:19.837010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1098/2174] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:11:19.841220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:19.854192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecc7c5-2a60-49b2-a4d1-ad6c87d351c7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:19.860396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:19.861064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:19.861413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:19.865258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:19.865258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:19.865446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:19.872467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630fd5df6ab94946af76681a680751aa', 'request_id': 'req-c6670390-9191-47b9-954c-2a1d617d2f37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.878259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630fd5df6ab94946af76681a680751aa', 'request_id': 'req-c6670390-9191-47b9-954c-2a1d617d2f37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.950728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1099/2175] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:19 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:19.954761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:19.955757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630fd5df6ab94946af76681a680751aa', 'request_id': 'req-c6670390-9191-47b9-954c-2a1d617d2f37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.967836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] The token cache is being invalidate because project 630fd5df6ab94946af76681a680751aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:19.968135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.968793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:19.970356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1077/2176] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:19 2022] DELETE /identity/v3/projects/630fd5df6ab94946af76681a680751aa => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:20.024487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef347a-05e2-4754-be7a-ba2a7e689f5c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.036124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.036855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.037199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.037486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.038207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.040437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.121527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1100/2177] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:19 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:20.125919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.127616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:20.194243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6670390-9191-47b9-954c-2a1d617d2f37 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.198870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.199542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.199857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.200138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.200866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.202459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.212624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1078/2178] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:20.216731 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.227506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca40263-9543-49cd-8929-9b9e3732a9be admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.232143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.232804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.233087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.233363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.234124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.235732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b1627-97be-4664-9323-efb573876548 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.238618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:20.247353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1101/2179] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:20.251799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.262559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad46c92-dc2c-4c8c-a529-b7ad592708e7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.267094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.268113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.268398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.268673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] PATH_INFO: `/v3/projects/6231e90b01094f37a503afe75c6a7072/users/76fa28662b774bc383b30fbf96e986b7/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.284418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6231e90b01094f37a503afe75c6a7072, user_id=76fa28662b774bc383b30fbf96e986b7, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.287769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.391051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1079/2180] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:20 2022] PUT /identity/v3/projects/6231e90b01094f37a503afe75c6a7072/users/76fa28662b774bc383b30fbf96e986b7/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:20.401464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.401758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.402041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.430431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] MFA Rules not processed for user `76fa28662b774bc383b30fbf96e986b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:20.432972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:20.499910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1102/2181] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:20.504419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.568857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab33c66-aa52-4751-b444-96e9af5a8f47 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.573615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.577879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.577879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.577879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.577879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.577879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.688693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1080/2182] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:20 2022] POST /identity/v3/projects => generated 365 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:20.693292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.704137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767f250-9739-464f-82ae-7945a7f33870 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.762270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.762948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.763238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.763524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.764241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.766153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.903264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1103/2183] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:20 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:20.905066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.918227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bf92bc-bafd-4009-89fb-ae6bd23dca06 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.923378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.924700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.924700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.924989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.926441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:20.928614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:20.946877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1081/2184] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:20.947307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:20.961728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985dcc4b-b00b-4922-be8d-5027477ae204 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:20.967300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:20.968281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:20.968655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:20.968863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] PATH_INFO: `/v3/projects/4f9434d1d56b4174b13d04f193615047/users/8ff3c458d6a446ae8f1e798e6282698a/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:20.992870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9434d1d56b4174b13d04f193615047, user_id=8ff3c458d6a446ae8f1e798e6282698a, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:21.003693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:21.075584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:21.106368 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1104/2185] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:20 2022] PUT /identity/v3/projects/4f9434d1d56b4174b13d04f193615047/users/8ff3c458d6a446ae8f1e798e6282698a/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:21.109232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:21.120617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67c98-f319-4476-a7bd-38f70dc02e5e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:21.176503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:21.177172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:21.177460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:21.177739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:21.178459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:21.180083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a92242-a6d0-4853-bd72-ccfcac20295b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:21.189884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1082/2186] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:21.193917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:21.204232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eac2b-503d-4dad-ad12-e0a6f521b6c1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:21.209623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:21.210508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:21.210795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:21.211093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] PATH_INFO: `/v3/projects/4f9434d1d56b4174b13d04f193615047/users/8ff3c458d6a446ae8f1e798e6282698a/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:21.213099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9434d1d56b4174b13d04f193615047, user_id=8ff3c458d6a446ae8f1e798e6282698a, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:21.215760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:21.227992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1105/2187] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:21 2022] PUT /identity/v3/projects/4f9434d1d56b4174b13d04f193615047/users/8ff3c458d6a446ae8f1e798e6282698a/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:21.239801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:21.243809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:21.243809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:21.266034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] MFA Rules not processed for user `8ff3c458d6a446ae8f1e798e6282698a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:21.267358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:21.333612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1083/2188] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:21.443512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:21.445371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:21.505448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c7a95b-0f75-45ad-a0d6-0b54d18cec79 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:21.509141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:21.509800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:21.510088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:21.510366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:21.523821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:21.523821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a3d13-2472-48c4-9cd9-ff7b577d9133 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:21.534279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1106/2189] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:21.911722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:23.978373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:25.436153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:25.520953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f6ba2-8da9-41bf-857c-ac1a18705881 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:25.525319 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:25.526282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:25.526568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:25.526849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] PATH_INFO: `/v3/users/76fa28662b774bc383b30fbf96e986b7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:25.528147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fa28662b774bc383b30fbf96e986b7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:25.530138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:25.794233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fa28662b774bc383b30fbf96e986b7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:25.810315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fa28662b774bc383b30fbf96e986b7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:25.887394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fa28662b774bc383b30fbf96e986b7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:25.896662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fa28662b774bc383b30fbf96e986b7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:25.897414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fa28662b774bc383b30fbf96e986b7'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:25.916502 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1084/2190] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:25 2022] DELETE /identity/v3/users/76fa28662b774bc383b30fbf96e986b7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:25.918402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:25.918832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:25.919248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:25.943349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:25.944996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:26.027488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1107/2191] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:26.036392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:26.038352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:26.054203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:26.116835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9557ae3-730f-41ec-8869-6f24264fc3c8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:26.120881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:26.121543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:26.121829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:26.122112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:26.132127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:26.133571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:26.147010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1085/2192] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:26.622510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:26.623938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:26.643099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5df69-d1ed-45c1-b5ed-4c76cdc2dbbc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:26.650347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:26.651670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:26.652073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:26.652456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] PATH_INFO: `/v3/projects/6231e90b01094f37a503afe75c6a7072` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:26.653828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6231e90b01094f37a503afe75c6a7072)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:26.656198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:26.829061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6231e90b01094f37a503afe75c6a7072', 'request_id': 'req-d64a91e8-6c53-44ab-94b9-eba142e3717f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:26.838748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6231e90b01094f37a503afe75c6a7072', 'request_id': 'req-d64a91e8-6c53-44ab-94b9-eba142e3717f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:26.938048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6231e90b01094f37a503afe75c6a7072', 'request_id': 'req-d64a91e8-6c53-44ab-94b9-eba142e3717f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:26.950190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] The token cache is being invalidate because project 6231e90b01094f37a503afe75c6a7072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:26.950479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:26.951136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:26.952724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1108/2193] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:26 2022] DELETE /identity/v3/projects/6231e90b01094f37a503afe75c6a7072 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:26.957365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:26.968074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f67c64-4b9a-4a11-931a-2cfec07e9c33 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:27.066422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:27.067883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:27.068246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:27.068619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] PATH_INFO: `/v3/users/8ff3c458d6a446ae8f1e798e6282698a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:27.073644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff3c458d6a446ae8f1e798e6282698a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:27.075789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:27.290868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff3c458d6a446ae8f1e798e6282698a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:27.307700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff3c458d6a446ae8f1e798e6282698a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:27.383850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff3c458d6a446ae8f1e798e6282698a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:27.396929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff3c458d6a446ae8f1e798e6282698a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:27.399911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a48cfa8b-b1eb-4f52-a3ff-a0a3a358d95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff3c458d6a446ae8f1e798e6282698a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:27.413006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1086/2194] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:26 2022] DELETE /identity/v3/users/8ff3c458d6a446ae8f1e798e6282698a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:27.929236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:27.931222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:27.954205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a91e8-6c53-44ab-94b9-eba142e3717f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.029679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.030672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.030953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.031278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] PATH_INFO: `/v3/projects/4f9434d1d56b4174b13d04f193615047` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.032648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9434d1d56b4174b13d04f193615047)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.034947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.044298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:28.180443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9434d1d56b4174b13d04f193615047', 'request_id': 'req-06e42601-969c-4568-a8c2-015a4eca75fa'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.187464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9434d1d56b4174b13d04f193615047', 'request_id': 'req-06e42601-969c-4568-a8c2-015a4eca75fa'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.292222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9434d1d56b4174b13d04f193615047', 'request_id': 'req-06e42601-969c-4568-a8c2-015a4eca75fa'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.304961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] The token cache is being invalidate because project 4f9434d1d56b4174b13d04f193615047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:28.305246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.305894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.307449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1109/2195] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:27 2022] DELETE /identity/v3/projects/4f9434d1d56b4174b13d04f193615047 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:28.312442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2d68-e855-4c1e-b402-e258e1767370 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.319657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2d68-e855-4c1e-b402-e258e1767370 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.319657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d2d68-e855-4c1e-b402-e258e1767370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.333180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8f7d2d68-e855-4c1e-b402-e258e1767370 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:28.334629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8f7d2d68-e855-4c1e-b402-e258e1767370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:28.355548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:28.397754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.399239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:28.403517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1087/2196] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:28.413685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.414150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.414439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.416620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e42601-969c-4568-a8c2-015a4eca75fa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.421422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.422627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.423153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.423722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] PATH_INFO: `/v3/users/6328ea929a8641f78744160e8f7e8ed7` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.425663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6328ea929a8641f78744160e8f7e8ed7)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.427627 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.435652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:28.436901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:28.446090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1088/2197] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:28.452415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.462712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459b39-e68d-4753-ac75-912a47830de0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.469032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.469032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.469032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.469032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.470062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:28.470166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.473293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.490697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1089/2198] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:28.500246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.511381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099cc44-16b8-4bf7-9ea9-4a3f16af005f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.516303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.516965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.517251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.517530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.518221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.520758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.586904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6328ea929a8641f78744160e8f7e8ed7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.588197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6328ea929a8641f78744160e8f7e8ed7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.589339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6328ea929a8641f78744160e8f7e8ed7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.598021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1090/2199] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:28 2022] POST /identity/v3/projects => generated 391 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:28.603623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.604375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6328ea929a8641f78744160e8f7e8ed7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.605720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:28.622884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6328ea929a8641f78744160e8f7e8ed7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:28.679742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38766dd6-d272-4ac7-bf06-e2200d6f3e91 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.684419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.685093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.685380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.685658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.686380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.688332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.726617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1110/2200] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:28 2022] DELETE /identity/v3/users/6328ea929a8641f78744160e8f7e8ed7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:28.798083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1091/2201] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:28 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:28.801001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.888750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a191ee8-0ff2-48dd-9e25-af7a4440ad70 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.893569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.894785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.895068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.895351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.896124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.897721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.912678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1111/2202] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:28.914559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.925727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287f80c-9666-4bf3-aebf-a35eb6b2b031 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.930301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.931129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.931430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.931744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.932468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.934081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.945865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1092/2203] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:28.950111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.956663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:28.960580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498ac4-81f9-4c82-b4bc-3c83913dc2ae admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:28.965318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:28.966202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:28.966488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:28.966770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] PATH_INFO: `/v3/projects/5baf09e80d27420b998f6241ed4668ba/users/ee6e8096dacf4d89a4e2e1d274934d2d/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:28.983592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5baf09e80d27420b998f6241ed4668ba, user_id=ee6e8096dacf4d89a4e2e1d274934d2d, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:28.988477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:28.988610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546b619b-3551-4e4b-9681-ffa09795cb8f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:28.989341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.004460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23630cd0-ea01-45b2-841c-9830d37e8b1a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.009152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.010062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.010355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.010916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] PATH_INFO: `/v3/projects/865019aef812439f9a7c8d28d38f8623` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.012206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] RBAC: Authorizing `identity:delete_project(project_id=865019aef812439f9a7c8d28d38f8623)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.014296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.105194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1112/2204] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:28 2022] PUT /identity/v3/projects/5baf09e80d27420b998f6241ed4668ba/users/ee6e8096dacf4d89a4e2e1d274934d2d/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:29.115936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.116236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.116522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.143590 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] MFA Rules not processed for user `ee6e8096dacf4d89a4e2e1d274934d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:29.144812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865019aef812439f9a7c8d28d38f8623', 'request_id': 'req-ad7e6533-32a3-49ea-9a9e-d823c821b78d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.144944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.149661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:29.150934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865019aef812439f9a7c8d28d38f8623', 'request_id': 'req-ad7e6533-32a3-49ea-9a9e-d823c821b78d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.215490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1113/2205] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:29.216456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.218415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865019aef812439f9a7c8d28d38f8623', 'request_id': 'req-ad7e6533-32a3-49ea-9a9e-d823c821b78d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.231509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] The token cache is being invalidate because project 865019aef812439f9a7c8d28d38f8623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:29.231829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.232496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.234217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1093/2206] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:28 2022] DELETE /identity/v3/projects/865019aef812439f9a7c8d28d38f8623 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:29.241772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.243938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.292273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0992669-472e-4537-b39c-bf7d962fc6ff None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.297431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.298097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.298384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.298667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.299365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.301951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.313791 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e6533-32a3-49ea-9a9e-d823c821b78d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.319367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.320279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.320614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.321034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] PATH_INFO: `/v3/users/649c9b70303d4076a53af89ce01d9c9d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.322250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=649c9b70303d4076a53af89ce01d9c9d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.324224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.391597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1114/2207] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:29 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:29.395548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.397157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.461344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:29.466522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2218c1d8-590b-466f-8cfd-7b58b6d3c3ee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.471624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.473167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.473582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.473975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.475502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.477654 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.506699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649c9b70303d4076a53af89ce01d9c9d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.524248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649c9b70303d4076a53af89ce01d9c9d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.596655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1115/2208] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:29 2022] POST /identity/v3/users => generated 303 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:29.602520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.613957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abdf-3355-442c-b41b-660e86bc888a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.618636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.619298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.619646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.619921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.620642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.622475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.623654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649c9b70303d4076a53af89ce01d9c9d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.631249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649c9b70303d4076a53af89ce01d9c9d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.631920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649c9b70303d4076a53af89ce01d9c9d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:29.633839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1116/2209] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:29.638451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1094/2210] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:29 2022] DELETE /identity/v3/users/649c9b70303d4076a53af89ce01d9c9d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:29.639013 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.640697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.657968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263775c8-d0e2-4dd7-b44e-5c4e6a82ba19 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.734397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.735297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.735597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.735880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] PATH_INFO: `/v3/projects/c7fcf84b105f4f36910254afa9a683b1/users/56fb3a277d064e9998b54d67c94a95fb/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.752806 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fcf84b105f4f36910254afa9a683b1, user_id=56fb3a277d064e9998b54d67c94a95fb, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.755989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.864532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1117/2211] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:29 2022] PUT /identity/v3/projects/c7fcf84b105f4f36910254afa9a683b1/users/56fb3a277d064e9998b54d67c94a95fb/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:29.874061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.884877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d623e-1dcf-4641-ae42-3e2903bd9437 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:29.897741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:29.901642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:29.970719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:29.971664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:29.972007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:29.972294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:29.973033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:29.974668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:29.981634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:30.000121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1095/2212] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:30.000293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec2858-7d15-4baf-9f3e-00c3f75da852 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.000722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.000838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.000838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.000838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.000838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] PATH_INFO: `/v3/projects/28b847dc93ff4befbdba146b0aa2438b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.001153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b847dc93ff4befbdba146b0aa2438b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.001153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.001313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024eadc-b5e2-435f-8550-0ddf8622f1ba admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.006493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.007766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.008060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.008338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] PATH_INFO: `/v3/projects/c7fcf84b105f4f36910254afa9a683b1/users/56fb3a277d064e9998b54d67c94a95fb/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.010383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7fcf84b105f4f36910254afa9a683b1, user_id=56fb3a277d064e9998b54d67c94a95fb, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.013696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316dd32e-f2ed-47a7-9be2-32e7e6518122 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.027037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1096/2213] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:29 2022] PUT /identity/v3/projects/c7fcf84b105f4f36910254afa9a683b1/users/56fb3a277d064e9998b54d67c94a95fb/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:30.039643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.039862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.040129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.068004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] MFA Rules not processed for user `56fb3a277d064e9998b54d67c94a95fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:30.070049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.129787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b847dc93ff4befbdba146b0aa2438b', 'request_id': 'req-170b507b-369a-4374-9e9e-a5a7311b9329'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:30.135447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b847dc93ff4befbdba146b0aa2438b', 'request_id': 'req-170b507b-369a-4374-9e9e-a5a7311b9329'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:30.137378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:30.141484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1097/2214] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:30.153086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.154525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.200835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b847dc93ff4befbdba146b0aa2438b', 'request_id': 'req-170b507b-369a-4374-9e9e-a5a7311b9329'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:30.213825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] The token cache is being invalidate because project 28b847dc93ff4befbdba146b0aa2438b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:30.214567 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:30.215279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-170b507b-369a-4374-9e9e-a5a7311b9329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:30.215518 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a0faf-ea34-43eb-b7c5-4643a35c53dd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.217343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1118/2215] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:29 2022] DELETE /identity/v3/projects/28b847dc93ff4befbdba146b0aa2438b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:30.222512 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088505-a4a5-49a7-ac29-8514de8d00f2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.222810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088505-a4a5-49a7-ac29-8514de8d00f2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.223130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb088505-a4a5-49a7-ac29-8514de8d00f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.242356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eb088505-a4a5-49a7-ac29-8514de8d00f2 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:30.244697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eb088505-a4a5-49a7-ac29-8514de8d00f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.277383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.277964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.278251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.278531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.280381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.306881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1119/2216] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:30.314235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.314533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.314819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.325642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:30.333834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:30.335219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.345086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1120/2217] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:30.349437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.350072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.351206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.360633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d131ce-5507-46c9-84a8-582d2a4cc223 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.364936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1098/2218] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:30.366442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.367108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.367393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.367695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.368420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:30.368728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.370341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.385559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1121/2219] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:11:30.390014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.400540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f8c54-3478-4eae-b791-cd04752faa1e service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.405201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.405978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.406397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.406711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.407523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.409554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.415336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.419892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.436379 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25d820-d32e-4f71-bea5-57a119f849f3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.440266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.441502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.441812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.442114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.443937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:30.497232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1099/2220] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:30.498175 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.513856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.515852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.531737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1122/2221] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:30.582633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc9d52e-bfb2-4647-a437-c5111a9f90de admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.588902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.589738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.590023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.590416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.591125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.591125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.715942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1100/2222] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:30.720664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.735508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e6817-40fd-44bd-9ebf-0b9118d35a22 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.741670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.742342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.742624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.742900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.743655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.745969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.756845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1123/2223] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:30.761148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.772266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db88f6-24d0-46f3-9018-1bdecc3f07ae admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.777040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.777716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.778000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.778278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.779004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.780657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde9c00-6716-4e90-bdeb-496746bab59b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.791585 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1101/2224] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:30.795757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:30.807012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b1933-ff24-4151-aad9-b7460e69a61b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:30.811742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:30.812663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.812972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.813247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] PATH_INFO: `/v3/projects/0c8bd640078543ad94bb79992b1cd5d6/users/cd93c56a31314596a5bfa45a058ea98f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:30.828604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c8bd640078543ad94bb79992b1cd5d6, user_id=cd93c56a31314596a5bfa45a058ea98f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:30.831272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:30.950192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1124/2225] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:30 2022] PUT /identity/v3/projects/0c8bd640078543ad94bb79992b1cd5d6/users/cd93c56a31314596a5bfa45a058ea98f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:30.962824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56156-382d-4813-badb-8c245817c87a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:30.963285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56156-382d-4813-badb-8c245817c87a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:30.963611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc56156-382d-4813-badb-8c245817c87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.010191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3fc56156-382d-4813-badb-8c245817c87a None None] MFA Rules not processed for user `cd93c56a31314596a5bfa45a058ea98f`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:31.013606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3fc56156-382d-4813-badb-8c245817c87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:31.090739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1102/2226] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:31.095346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.131983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:31.162017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd467422-f7c9-419c-a4a2-9bd3ec0325a5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.167150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.167855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.168142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.168422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.169137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.171111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.290351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1125/2227] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:31 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:31.294264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc56156-382d-4813-badb-8c245817c87a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.305386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc56156-382d-4813-badb-8c245817c87a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.325610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:31.362436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.363280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.363604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.363893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.364605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.366536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.476487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1103/2228] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:31 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:31.480574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.491328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b7fd0-e44b-4a4c-8027-f7be372605a2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.496061 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.496734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.497023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.497306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.498044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.499660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.511833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1126/2229] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:31.516027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.526649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd8a55-f42c-42e2-a962-7bf54ad9f20a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.531213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.532129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.532413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.532690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] PATH_INFO: `/v3/projects/12b3b05b12fe442094340bbf128ab834/users/4d664c553f8145a4856664b3922dfa72/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.547084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b3b05b12fe442094340bbf128ab834, user_id=4d664c553f8145a4856664b3922dfa72, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.549725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.681476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1104/2230] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:31 2022] PUT /identity/v3/projects/12b3b05b12fe442094340bbf128ab834/users/4d664c553f8145a4856664b3922dfa72/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:31.685485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.696289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603a2e1-d3e9-4ebf-a824-7f0fe5463ae0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.753782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.754517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.754800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.755080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.755835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.757425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf164a7-4882-4c8c-9f2a-14ac3cec8be4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.767468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1127/2231] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:31.771513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.781811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b27003-4879-437f-a9da-9c2a694b0f1d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.786413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.787320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.787642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.787925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] PATH_INFO: `/v3/projects/12b3b05b12fe442094340bbf128ab834/users/4d664c553f8145a4856664b3922dfa72/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.789917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=12b3b05b12fe442094340bbf128ab834, user_id=4d664c553f8145a4856664b3922dfa72, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:31.792582 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:31.803597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1105/2232] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:31 2022] PUT /identity/v3/projects/12b3b05b12fe442094340bbf128ab834/users/4d664c553f8145a4856664b3922dfa72/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:31.814254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.814570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.814854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:31.841430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] MFA Rules not processed for user `4d664c553f8145a4856664b3922dfa72`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:31.842629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:31.909097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1128/2233] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:31.919952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:31.921649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:31.978793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019ab1a-d70f-4190-b0eb-5db93ebd39bd admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:31.982500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:31.983147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:31.983432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:31.983739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:32.049460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:32.051727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c74d5-e449-491b-a78c-afd3a3387856 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:32.062621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1106/2234] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:36.975240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:36.976709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:37.008601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:37.043695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184a9bb-718b-4cc2-8d7b-65ab0b116e16 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:37.048325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:37.049244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:37.049526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:37.049808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] PATH_INFO: `/v3/users/ee6e8096dacf4d89a4e2e1d274934d2d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:37.051357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6e8096dacf4d89a4e2e1d274934d2d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:37.054308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:37.231060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6e8096dacf4d89a4e2e1d274934d2d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:37.231766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6e8096dacf4d89a4e2e1d274934d2d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:37.232440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6e8096dacf4d89a4e2e1d274934d2d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:37.239419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6e8096dacf4d89a4e2e1d274934d2d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:37.253290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6e8096dacf4d89a4e2e1d274934d2d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:37.332480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1129/2235] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:36 2022] DELETE /identity/v3/users/ee6e8096dacf4d89a4e2e1d274934d2d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:37.337504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:37.338325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:37.338619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:37.361799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:37.362995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:37.392542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:37.434325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1107/2236] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:37.444346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:37.445916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:37.507971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ab68d-3dfd-4928-a1c2-be191c5b5975 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:37.511995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:37.512649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:37.512970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:37.513255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:37.522560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:37.524029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:37.533571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1130/2237] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:37.984539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:37.986243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:38.000177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8986326-b5f7-4136-a0c7-2d89965fd849 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:38.007933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:38.010669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:38.010669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:38.010669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] PATH_INFO: `/v3/projects/5baf09e80d27420b998f6241ed4668ba` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:38.011379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5baf09e80d27420b998f6241ed4668ba)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:38.013479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:38.116101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5baf09e80d27420b998f6241ed4668ba', 'request_id': 'req-ba47f8a3-de84-48f6-8e42-336937c94208'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.129338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5baf09e80d27420b998f6241ed4668ba', 'request_id': 'req-ba47f8a3-de84-48f6-8e42-336937c94208'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.182101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5baf09e80d27420b998f6241ed4668ba', 'request_id': 'req-ba47f8a3-de84-48f6-8e42-336937c94208'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.198741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] The token cache is being invalidate because project 5baf09e80d27420b998f6241ed4668ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:38.199046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.199868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.201601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1108/2238] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:37 2022] DELETE /identity/v3/projects/5baf09e80d27420b998f6241ed4668ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:38.205388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:38.220184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeeebf-d8f4-4187-a22a-5948be45818c service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:38.264871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:38.279281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:38.280245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:38.280536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:38.280813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] PATH_INFO: `/v3/users/56fb3a277d064e9998b54d67c94a95fb` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:38.282071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fb3a277d064e9998b54d67c94a95fb)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:38.284062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:38.502961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fb3a277d064e9998b54d67c94a95fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.503835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fb3a277d064e9998b54d67c94a95fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.504545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fb3a277d064e9998b54d67c94a95fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.512956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fb3a277d064e9998b54d67c94a95fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.525901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d16c0aba-d509-46f8-9df2-f68d3fb32a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fb3a277d064e9998b54d67c94a95fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:38.606055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1131/2239] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:38 2022] DELETE /identity/v3/users/56fb3a277d064e9998b54d67c94a95fb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:39.006793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.006793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:39.018816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba47f8a3-de84-48f6-8e42-336937c94208 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.080716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.081521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.081806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.082082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] PATH_INFO: `/v3/projects/c7fcf84b105f4f36910254afa9a683b1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.083301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7fcf84b105f4f36910254afa9a683b1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.085278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.235504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7fcf84b105f4f36910254afa9a683b1', 'request_id': 'req-bed103ad-df0f-4121-8349-67d3889434be'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:39.244577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:39.245990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7fcf84b105f4f36910254afa9a683b1', 'request_id': 'req-bed103ad-df0f-4121-8349-67d3889434be'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:39.368315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7fcf84b105f4f36910254afa9a683b1', 'request_id': 'req-bed103ad-df0f-4121-8349-67d3889434be'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:39.381162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] The token cache is being invalidate because project c7fcf84b105f4f36910254afa9a683b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:39.381937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:39.382701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-bed103ad-df0f-4121-8349-67d3889434be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:39.384817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1109/2240] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:39 2022] DELETE /identity/v3/projects/c7fcf84b105f4f36910254afa9a683b1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:39.389837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.390334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.390430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.409075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:39.410264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:39.468500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1132/2241] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:39.477355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.477653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.477937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.498273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:39.501808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:39.509313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1110/2242] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:39.513822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.524243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6134a-2878-440f-a12f-a9b2d505822a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.529114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.529891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.530256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.530683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.531581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:39.531913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.533540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.546728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1133/2243] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:39.558058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.567628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28a701c-6c4d-49d1-9c7a-1e38c7aad6f4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.573113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.573756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.574043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.574323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.575023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.576946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.641987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1111/2244] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:39.646166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.657844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175e0fb-b402-438a-8da9-7385febb5c36 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.710182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:39.717154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.717829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.718131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.718405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.719095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.721073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.772591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1134/2245] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:39 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:39.776899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.787614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d25773-8757-4072-9487-189efd0c2e01 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.792276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.792945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.793262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.793500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.794249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.795891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.806713 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1112/2246] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:11:39.810908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.821868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fc675-04fe-41be-99d6-a1bc5bf7b913 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.827011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.827723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.828011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.828290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.829033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.830645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe305a-cecc-4c72-888c-db564ae1d922 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.843770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1135/2247] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:39.847992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:39.857917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52467eb-5398-468d-9962-41fd3f4ca425 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:39.862443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:39.863311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.863628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.863908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] PATH_INFO: `/v3/projects/a6efde9d16a042f4bece36dd2916056f/users/f46a47a15e8f4137ac5c7ab878e938b9/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:39.880650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6efde9d16a042f4bece36dd2916056f, user_id=f46a47a15e8f4137ac5c7ab878e938b9, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:39.884053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:39.978417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1113/2248] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:39 2022] PUT /identity/v3/projects/a6efde9d16a042f4bece36dd2916056f/users/f46a47a15e8f4137ac5c7ab878e938b9/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:39.989781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:39.990075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:39.990385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.018949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] MFA Rules not processed for user `f46a47a15e8f4137ac5c7ab878e938b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:40.020449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.096335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1136/2249] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:40.109939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:40.111697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.172027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce28332-18a6-489e-942b-a9cba63ef769 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:40.175731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:40.176387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:40.176673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:40.176955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.186007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:40.187445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:40.198708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1114/2250] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:40.217662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:40.281818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc54b57-4c5f-40be-b5b0-30f152b4b8b3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:40.286472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:40.287340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:40.288168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:40.288443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] PATH_INFO: `/v3/users/f46a47a15e8f4137ac5c7ab878e938b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.289651 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f46a47a15e8f4137ac5c7ab878e938b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:40.291585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:40.434953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:40.436635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.449282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be303311-8db1-4b9e-ae47-8e9bfcac0226 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:40.453549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:40.454208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:40.454495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:40.454774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.456648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.501473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f46a47a15e8f4137ac5c7ab878e938b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:40.501473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f46a47a15e8f4137ac5c7ab878e938b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:40.501473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f46a47a15e8f4137ac5c7ab878e938b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:40.509419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f46a47a15e8f4137ac5c7ab878e938b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:40.521272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:40.528716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f46a47a15e8f4137ac5c7ab878e938b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:40.531523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:40.533369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154f38a6-8008-4811-bf1f-1b3bbee8111e service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:40.544786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1115/2251] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:40.590090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1137/2252] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:40 2022] DELETE /identity/v3/users/f46a47a15e8f4137ac5c7ab878e938b9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:40.594785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:40.595403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:40.595512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.618352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:40.619587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.635113 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:40.693755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1116/2253] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:40.706282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:40.708124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:40.769025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0a3ca-e712-47a0-ac28-8416f9a11fa2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:40.773345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:40.774020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:40.774307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:40.774587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:40.785120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:40.785242 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13dd40-1d26-45bf-89a2-2509ff4a2add service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:40.796183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1138/2254] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:41.331252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:41.331252 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:41.346375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e134c-3dd9-4931-9a51-2c7687debd6c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:41.351893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:41.354137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.354137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.354137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] PATH_INFO: `/v3/projects/a6efde9d16a042f4bece36dd2916056f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.355037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6efde9d16a042f4bece36dd2916056f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:41.357060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:41.501409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6efde9d16a042f4bece36dd2916056f', 'request_id': 'req-d40ad5fe-be11-4dea-92c9-9b27db2917fb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:41.508187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6efde9d16a042f4bece36dd2916056f', 'request_id': 'req-d40ad5fe-be11-4dea-92c9-9b27db2917fb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:41.623696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6efde9d16a042f4bece36dd2916056f', 'request_id': 'req-d40ad5fe-be11-4dea-92c9-9b27db2917fb'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:41.637338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] The token cache is being invalidate because project a6efde9d16a042f4bece36dd2916056f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:41.637627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:41.638497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d40ad5fe-be11-4dea-92c9-9b27db2917fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:41.643501 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1117/2255] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:41 2022] DELETE /identity/v3/projects/a6efde9d16a042f4bece36dd2916056f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:41.645233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.645702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.645795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.665537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:41.666757 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:41.728518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1139/2256] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:41.736345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.736641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.736928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.757475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:41.758764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:41.767093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1118/2257] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:41.771463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:41.781769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5adc4-64c0-41ad-b4c2-9adb4cb5ab87 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:41.786410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:41.787066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.787961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.788226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.788958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:41.789266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:41.790860 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:41.802427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1140/2258] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:41.807777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:41.817328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095398f-92d9-4f2e-8d12-810de58ca29a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:41.822075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:41.822729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.823016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.823297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.824030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:41.825911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:41.898754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1119/2259] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:41 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:41.902914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:41.913537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272eccc3-4f37-40a0-bf36-8ddd5208b407 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:41.972248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:41.972950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:41.973240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:41.973522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:41.974216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:41.977372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:42.063891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1141/2260] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:41 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:42.068019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:42.078297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392997-bac1-465f-8c3e-2aaa1cf04ea0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:42.082831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:42.083488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:42.083826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:42.084079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:42.084799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:42.086417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:42.097234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1120/2261] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:42.102043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:42.107583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:42.112969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedb9c2-44b2-4147-9396-a1a6f8e9f2d2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:42.118481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:42.119194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:42.119485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:42.119804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:42.120597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:42.122205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534d1b8-c019-4b41-8e8a-d519eaf0292d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:42.135941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1142/2262] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:42.140322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:42.151503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd8567-ffcb-4970-84b8-55df7d4dc521 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:42.156519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:42.160657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:42.160657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:42.160657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] PATH_INFO: `/v3/projects/4ccc63b296f24c93a2502240a00e4e62/users/12d7d69c99d5458ca53f5a4322db18cd/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:42.182737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccc63b296f24c93a2502240a00e4e62, user_id=12d7d69c99d5458ca53f5a4322db18cd, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:42.185471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:42.269484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1121/2263] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:42 2022] PUT /identity/v3/projects/4ccc63b296f24c93a2502240a00e4e62/users/12d7d69c99d5458ca53f5a4322db18cd/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:42.280454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:42.280752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:42.281037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:42.308374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] MFA Rules not processed for user `12d7d69c99d5458ca53f5a4322db18cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:42.309839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:42.376198 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1143/2264] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:42.387377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:42.389300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:42.434070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:42.449596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3afb08-6fa7-454e-8cae-2949e25b80b3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:42.453787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:42.454437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:42.454717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:42.454992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:42.463969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:42.465469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:42.476327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1122/2265] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:47.371945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:47.373766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:47.469335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec66d6d-7b83-4a34-bb6e-1b189b34d909 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:47.484572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:47.485088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:47.487469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:47.487867 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:47.494792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] PATH_INFO: `/v3/users/cd93c56a31314596a5bfa45a058ea98f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:47.494792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd93c56a31314596a5bfa45a058ea98f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:47.494792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:47.497648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea83589-dfc3-4cf4-b4de-1a1a87aff85b service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:47.502653 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:47.503689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:47.504033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:47.504382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] PATH_INFO: `/v3/users/12d7d69c99d5458ca53f5a4322db18cd` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:47.506162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d7d69c99d5458ca53f5a4322db18cd)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:47.508235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:47.706071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd93c56a31314596a5bfa45a058ea98f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.706699 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd93c56a31314596a5bfa45a058ea98f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.707265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd93c56a31314596a5bfa45a058ea98f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.714385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd93c56a31314596a5bfa45a058ea98f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.727050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4836540b-f10c-4049-b040-42e4a534fef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd93c56a31314596a5bfa45a058ea98f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.758693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d7d69c99d5458ca53f5a4322db18cd'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.772284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d7d69c99d5458ca53f5a4322db18cd'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.818693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:47.823279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1144/2266] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:47 2022] DELETE /identity/v3/users/cd93c56a31314596a5bfa45a058ea98f => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:47.827834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:47.828129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:47.828415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:47.845541 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:47.846725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:47.868912 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d7d69c99d5458ca53f5a4322db18cd'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.876590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d7d69c99d5458ca53f5a4322db18cd'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.877257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3951d6b0-1549-483b-bd69-c2fa33f95fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d7d69c99d5458ca53f5a4322db18cd'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:47.883398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1123/2267] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:47 2022] DELETE /identity/v3/users/12d7d69c99d5458ca53f5a4322db18cd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:47.888278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:47.888576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:47.888867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:47.907888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1145/2268] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:47.908367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:47.909577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:47.920970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:47.922301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:47.989644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1124/2269] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:47.993802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b3520-913f-4bac-a443-2dd1ab04263c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:48.002300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:48.048780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:48.049521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:48.049811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:48.050097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:48.060062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:48.061551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:48.071271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ec693-6b6d-4f38-acbb-fd09e747253d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:48.072400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1146/2270] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:48.075649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:48.076412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:48.076714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:48.076995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:48.084697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:48.088027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:48.089360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:48.099381 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1125/2271] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:48.671935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:48.676001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:48.677168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:48.680258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:48.696661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dac121-5744-4a17-bf7e-3fcc6d78162c service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:48.707725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1427e-dc67-4184-b836-55329ebfcf6e service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:48.710223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:48.711375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:48.711752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:48.712189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] PATH_INFO: `/v3/projects/0c8bd640078543ad94bb79992b1cd5d6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:48.713693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c8bd640078543ad94bb79992b1cd5d6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:48.715877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:48.724853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:48.725789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:48.726826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:48.727350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] PATH_INFO: `/v3/projects/4ccc63b296f24c93a2502240a00e4e62` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:48.730402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccc63b296f24c93a2502240a00e4e62)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:48.733500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:48.817078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c8bd640078543ad94bb79992b1cd5d6', 'request_id': 'req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.821042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:48.823207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c8bd640078543ad94bb79992b1cd5d6', 'request_id': 'req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.840927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccc63b296f24c93a2502240a00e4e62', 'request_id': 'req-5a45bb46-e087-4574-a475-d9a02783880d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.846513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccc63b296f24c93a2502240a00e4e62', 'request_id': 'req-5a45bb46-e087-4574-a475-d9a02783880d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.903123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c8bd640078543ad94bb79992b1cd5d6', 'request_id': 'req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.915458 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] The token cache is being invalidate because project 0c8bd640078543ad94bb79992b1cd5d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:48.915777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.916434 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.917972 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1147/2272] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:48 2022] DELETE /identity/v3/projects/0c8bd640078543ad94bb79992b1cd5d6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:48.921840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:48.923262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:48.983118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccc63b296f24c93a2502240a00e4e62', 'request_id': 'req-5a45bb46-e087-4574-a475-d9a02783880d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.992200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba1f9d-948c-4ed3-94c2-b8130dc202ac admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:48.996954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] The token cache is being invalidate because project 4ccc63b296f24c93a2502240a00e4e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:48.997354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.998065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-5a45bb46-e087-4574-a475-d9a02783880d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:48.999998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1126/2273] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:48 2022] DELETE /identity/v3/projects/4ccc63b296f24c93a2502240a00e4e62 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:49.013089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f59c5-01cf-4c96-b12b-d4b0275c181f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.015116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f59c5-01cf-4c96-b12b-d4b0275c181f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.015116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f59c5-01cf-4c96-b12b-d4b0275c181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.033386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-477f59c5-01cf-4c96-b12b-d4b0275c181f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:49.034119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-477f59c5-01cf-4c96-b12b-d4b0275c181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:49.055374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.056186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.056469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.056743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] PATH_INFO: `/v3/users/4d664c553f8145a4856664b3922dfa72` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.057949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d664c553f8145a4856664b3922dfa72)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.059881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.097241 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1127/2274] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:49.105881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.106222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.106580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.124957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:49.126159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:49.135267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1128/2275] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:49.139078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.148606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe062df-d81e-497b-bd1c-ff41d49b1193 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.153312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.153945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.154230 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.154507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.155224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:49.155529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.157165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.169415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1129/2276] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:11:49.173709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.184536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e612ce-7e19-41a5-8c84-7da32c993743 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.189200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.189836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.190124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.190407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.191161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.193182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.314640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1130/2277] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:49 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:11:49.315747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.357058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:49.377361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1e0cc-d84c-4a76-881d-4d0d02ddf94d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.382778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.383441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.383752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.384031 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.384732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.386895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.403874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d664c553f8145a4856664b3922dfa72'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:49.410809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d664c553f8145a4856664b3922dfa72'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:49.410809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d664c553f8145a4856664b3922dfa72'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:49.412167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d664c553f8145a4856664b3922dfa72'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:49.424118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d664c553f8145a4856664b3922dfa72'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:49.497442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1131/2278] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:49 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:49.501249 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.502872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:49.516857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7ddc4-8790-460a-9771-d3d549017ca2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.525365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.525365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.525365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.525365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.525697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.527147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.529032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1148/2279] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:11:48 2022] DELETE /identity/v3/users/4d664c553f8145a4856664b3922dfa72 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:49.542021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1132/2280] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:11:49.543359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.556170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:49.616784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603385-4d3c-4db3-9a8b-141aa4fea370 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.621969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.622653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.622940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.623220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.624007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.625604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc085a4-f19f-4e8b-83a8-d5399d4565d1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.643133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1149/2281] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:49.644340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.657840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df9840-3071-49bf-9166-28260a491c54 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.665058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.665954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.666237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.666514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] PATH_INFO: `/v3/projects/c04fcd6058244df586e8bbbd8edecbb7/users/c506fffb10d842069208a92e6f9f778b/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.682049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04fcd6058244df586e8bbbd8edecbb7, user_id=c506fffb10d842069208a92e6f9f778b, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.684763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.751136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1133/2282] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:49 2022] PUT /identity/v3/projects/c04fcd6058244df586e8bbbd8edecbb7/users/c506fffb10d842069208a92e6f9f778b/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:11:49.765599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.766012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.768831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.798462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:49.799624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:49.861522 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1150/2283] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:49.872201 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:49.874190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:49.935707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363a9a2-e54e-4f39-b396-7afd36d045e5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:49.939933 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:49.940594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:49.940882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:49.941162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:49.951782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:49.953263 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb5215-68c6-482f-919b-5807971c25fc service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:49.965986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1134/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:50.024602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.026045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:50.047467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ca284-062a-43b6-b3d8-3f139a540fcc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.053414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.055785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.056327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.056816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] PATH_INFO: `/v3/projects/12b3b05b12fe442094340bbf128ab834` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.058618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12b3b05b12fe442094340bbf128ab834)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.062303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.206045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12b3b05b12fe442094340bbf128ab834', 'request_id': 'req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:50.211430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12b3b05b12fe442094340bbf128ab834', 'request_id': 'req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:50.268797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12b3b05b12fe442094340bbf128ab834', 'request_id': 'req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:50.281317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] The token cache is being invalidate because project 12b3b05b12fe442094340bbf128ab834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:11:50.281654 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:50.282321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e0c8b67e-6fef-4a9f-b6f7-b5897fb9fae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:11:50.284034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1151/2285] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:11:50 2022] DELETE /identity/v3/projects/12b3b05b12fe442094340bbf128ab834 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:50.290789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.291524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.291857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.311674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:50.312991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:50.372687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1135/2286] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:50.380982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.381549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.381835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.402792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:50.404105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:50.415404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1152/2287] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:50.417222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.427145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b79a9-eee2-44c1-8d28-caa359e8a1c5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.432555 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.433273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.433550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.435100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.435100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:11:50.435100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.436511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.450143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1136/2288] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:11:50.454499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.465085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997adddc-844f-4b04-81c6-2bd86e804ca4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.470859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.471574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.471862 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.472146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.472852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.474780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.601331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:50.607730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1153/2289] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:50 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:50.612081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.623067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e210b-aedc-483b-8b07-8184580d8618 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.644470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:50.683796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.684548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.684815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.685095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.686435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.688464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.774268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1137/2290] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:50 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:50.775503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.787083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950d7e3-d4ad-4bf9-9ac3-c62b762dbd54 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.792919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.793593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.793908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.794199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.794929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.796631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.808675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1154/2291] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:50.812710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.822925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac111f1-3d90-4aa2-8ed8-92f3bdb85c83 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.827496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.828185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.828468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.828747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.829466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.831053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fb6d-ff5c-4cc3-b1a3-6f32657a2d65 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.840906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1138/2292] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:50.845097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:50.855670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15a23-0591-4a03-83b8-57b0d52603ed admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:50.860353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:50.861233 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.861515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.861846 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] PATH_INFO: `/v3/projects/f80384748420413ea04c3fe9314b137b/users/6fec5ada3d0441fc84264cf702132322/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:50.877176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f80384748420413ea04c3fe9314b137b, user_id=6fec5ada3d0441fc84264cf702132322, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:50.879841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:50.960438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1155/2293] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:50 2022] PUT /identity/v3/projects/f80384748420413ea04c3fe9314b137b/users/6fec5ada3d0441fc84264cf702132322/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:50.972007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1188e-dc62-49d2-9138-1762f017183b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:50.972301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1188e-dc62-49d2-9138-1762f017183b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:50.972610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1188e-dc62-49d2-9138-1762f017183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.002278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-78c1188e-dc62-49d2-9138-1762f017183b None None] MFA Rules not processed for user `6fec5ada3d0441fc84264cf702132322`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:51.003638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-78c1188e-dc62-49d2-9138-1762f017183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:51.078984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1139/2294] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:51.083635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.162358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583000-af3a-4135-bd33-1d83ac6084ee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.176441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.176441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.176441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.176441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.176841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.176841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.258634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.258634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.258926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.291584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] MFA Rules not processed for user `c506fffb10d842069208a92e6f9f778b`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:51.292466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1156/2295] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:51.292809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:51.296494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.389771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0c75e-c3a3-4662-8fec-7ee33d7ecf56 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.392087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1140/2296] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:11:51.400832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.401535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.401822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.402103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.402805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.405273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.405447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.407087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:51.437332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:51.483253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520bfd4-487e-4a65-bc58-6e5a5edbaff9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.487120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.487814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.488105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.491499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.497885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.499326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.509907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1157/2297] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:51 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:51.511114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1141/2298] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:11:51.514464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.528241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652846f-cadb-4a3d-81a3-83ba30728129 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.533301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.534127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.534470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.534771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.535516 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.537327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.553029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1158/2299] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:51.555052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.569614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66424b11-bec3-4d6e-b1b9-d6ca87b5d40d service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.581378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.582112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.582393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.582664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.583453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.585182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a777b9-dec0-45c8-a3ad-d3d0a615c802 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.603468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1142/2300] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:51.608495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.616199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be914-5a8f-4543-b8dc-86c6d0c5b8f4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:51.622429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:51.623331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.623705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.623940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] PATH_INFO: `/v3/projects/c4d4a608e0724b3ba715738ef3eea81a/users/f3fd183abd1749408123a36be5961512/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.645271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d4a608e0724b3ba715738ef3eea81a, user_id=f3fd183abd1749408123a36be5961512, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:51.649712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:51.743056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1159/2301] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:51 2022] PUT /identity/v3/projects/c4d4a608e0724b3ba715738ef3eea81a/users/f3fd183abd1749408123a36be5961512/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:51.818641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:51.819205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:51.819205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:51.851126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] MFA Rules not processed for user `f3fd183abd1749408123a36be5961512`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:51.852636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:51.931004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1143/2302] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:51.935901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:51.942177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:52.013558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8c9e80-9218-4457-858d-51fccee7de64 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.018386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.019119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.019428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.019734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.020442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.022336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.134042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1160/2303] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:11:51 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:52.138456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.149869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12097ba2-5048-4847-b210-1dd8f57c6ca9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.240990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.242183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.242183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.242402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.243119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.245560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.337801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1144/2304] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:11:52 2022] POST /identity/v3/users => generated 299 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:11:52.341525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.352557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8902-9b14-4275-82d5-ed414265e77b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.363466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.364513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.364803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.365087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.365857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.368086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.386960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1161/2305] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:52.393412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.397328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfba4b-fa1e-4784-83b0-a8bfda30dc85 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.403244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.404177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.404490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.404770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] PATH_INFO: `/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d/users/5392247b23104c5394ec61c77fb1fb61/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.421244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ec7a11bbf416b8bc40b66c6f6f63d, user_id=5392247b23104c5394ec61c77fb1fb61, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.424069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.515956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1145/2306] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:52 2022] PUT /identity/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d/users/5392247b23104c5394ec61c77fb1fb61/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:52.519973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.530652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86572d02-c555-4e46-ad00-f0328599b5ac admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.588652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.589372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.589661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.589942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.590691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.592324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cac3ad-5d61-427e-b5e7-5e24960e8c0b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.606020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1162/2307] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:11:52.614383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.625515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b407ade-ebaa-4226-840a-5f81e6e272a6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.630214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.631098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.631380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.631688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] PATH_INFO: `/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d/users/5392247b23104c5394ec61c77fb1fb61/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.634749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ec7a11bbf416b8bc40b66c6f6f63d, user_id=5392247b23104c5394ec61c77fb1fb61, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.637297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.639663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:52.648748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1146/2308] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:11:52 2022] PUT /identity/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d/users/5392247b23104c5394ec61c77fb1fb61/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:11:52.658836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068183-bd8d-47ee-b0c9-54d36f0af452 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.659133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068183-bd8d-47ee-b0c9-54d36f0af452 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.659418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce068183-bd8d-47ee-b0c9-54d36f0af452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.688652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ce068183-bd8d-47ee-b0c9-54d36f0af452 None None] MFA Rules not processed for user `5392247b23104c5394ec61c77fb1fb61`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:52.689817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ce068183-bd8d-47ee-b0c9-54d36f0af452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:52.777747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:11:52.783068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1163/2309] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:52.795611 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:52.853588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0198b3ec-bbac-4824-810e-7cec243ef00d admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:52.857304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:52.857958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:52.858379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:52.858514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:52.917074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:52.918523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:52.927690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1147/2310] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:54.261192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:54.261675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:54.261767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:54.280138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] MFA Rules not processed for user `c506fffb10d842069208a92e6f9f778b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:11:54.281341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:54.339733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1164/2311] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:11:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:11:55.887488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:55.889213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:11:55.900876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86040bb-1b22-4a13-9ff0-119c9f80d9f4 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:55.904626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:55.906603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:55.906603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:55.906603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:55.964487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:55.965924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:55.974911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1148/2312] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:11:57.311987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:11:57.324101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f4d689-0a82-4e4d-89e4-e707ed06e380 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:11:57.328063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:11:57.328718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:11:57.329531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:11:57.329531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:11:57.339277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:11:57.340905 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e090e22-0566-43d6-b6be-2b3f754434b7 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:11:57.350452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1165/2313] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:11:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:04.132302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:04.200209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:04.215647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac326164-9854-49f2-adfc-56a7bec786f7 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:04.220302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:04.221189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:04.221476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:04.221758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] PATH_INFO: `/v3/users/6fec5ada3d0441fc84264cf702132322` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:04.222980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fec5ada3d0441fc84264cf702132322)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:04.225021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:04.441782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fec5ada3d0441fc84264cf702132322'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:04.454449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fec5ada3d0441fc84264cf702132322'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:04.514994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fec5ada3d0441fc84264cf702132322'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:04.522879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fec5ada3d0441fc84264cf702132322'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:04.523578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fec5ada3d0441fc84264cf702132322'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:04.530139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1149/2314] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:12:04 2022] DELETE /identity/v3/users/6fec5ada3d0441fc84264cf702132322 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:04.534701 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c943-0593-45d1-b634-adaa07bc8994 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:04.535196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c943-0593-45d1-b634-adaa07bc8994 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:04.535292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11c943-0593-45d1-b634-adaa07bc8994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:04.553087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2b11c943-0593-45d1-b634-adaa07bc8994 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:04.554322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2b11c943-0593-45d1-b634-adaa07bc8994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:04.614801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1166/2315] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:04.626096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:04.627625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:04.718911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c11f6-b0b2-404d-be1c-2b8b04557fe8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:04.722736 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:04.723391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:04.724216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:04.724216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:04.735367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:04.736927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:04.752371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1150/2316] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:05.075864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:05.076383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:05.076675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:05.096221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] MFA Rules not processed for user `10875af9fd904150ac8baac0a4c83a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:05.097431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:05.155895 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1167/2317] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:05.225205 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:05.226789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:05.243952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683653f-4822-4629-af39-7ae89b78d5c0 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:05.250234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:05.251181 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:05.251631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:05.251973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] PATH_INFO: `/v3/projects/f80384748420413ea04c3fe9314b137b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:05.253410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f80384748420413ea04c3fe9314b137b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:05.256549 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:05.415695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f80384748420413ea04c3fe9314b137b', 'request_id': 'req-91234170-72e6-4367-8c61-902fe9e9b439'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:05.424121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f80384748420413ea04c3fe9314b137b', 'request_id': 'req-91234170-72e6-4367-8c61-902fe9e9b439'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:05.429654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:05.489548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f80384748420413ea04c3fe9314b137b', 'request_id': 'req-91234170-72e6-4367-8c61-902fe9e9b439'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:05.507947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] The token cache is being invalidate because project f80384748420413ea04c3fe9314b137b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:12:05.508266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:05.509025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:05.512004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1151/2318] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:12:05 2022] DELETE /identity/v3/projects/f80384748420413ea04c3fe9314b137b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:05.516084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:05.537263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa090d63-ed51-49c6-acd6-c475140e3e22 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:05.577093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:05.604845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:05.606093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:05.606272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:05.606618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] PATH_INFO: `/v3/users/f3fd183abd1749408123a36be5961512` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:05.607960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fd183abd1749408123a36be5961512)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:05.610155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:06.091821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fd183abd1749408123a36be5961512'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.098760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fd183abd1749408123a36be5961512'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.099505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fd183abd1749408123a36be5961512'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.107851 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fd183abd1749408123a36be5961512'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.120953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fd183abd1749408123a36be5961512'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.264179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1168/2319] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:12:05 2022] DELETE /identity/v3/users/f3fd183abd1749408123a36be5961512 => generated 0 bytes in 749 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:06.716856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:06.721312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:06.732065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91234170-72e6-4367-8c61-902fe9e9b439 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:06.797697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:06.798661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:06.799025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:06.799397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] PATH_INFO: `/v3/projects/c4d4a608e0724b3ba715738ef3eea81a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:06.800865 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d4a608e0724b3ba715738ef3eea81a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:06.803058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:06.937387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d4a608e0724b3ba715738ef3eea81a', 'request_id': 'req-f947e487-6f6a-4bd8-a84f-fc813f20c03b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:06.942682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d4a608e0724b3ba715738ef3eea81a', 'request_id': 'req-f947e487-6f6a-4bd8-a84f-fc813f20c03b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.051299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d4a608e0724b3ba715738ef3eea81a', 'request_id': 'req-f947e487-6f6a-4bd8-a84f-fc813f20c03b'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.065748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] The token cache is being invalidate because project c4d4a608e0724b3ba715738ef3eea81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:12:07.066048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.066712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.068292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1152/2320] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:12:06 2022] DELETE /identity/v3/projects/c4d4a608e0724b3ba715738ef3eea81a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:07.072947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:07.074573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:07.087385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46615fe7-35ad-4f4f-9b0c-d60006255f03 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:07.157760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:07.158742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:07.159031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:07.159309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] PATH_INFO: `/v3/users/5392247b23104c5394ec61c77fb1fb61` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:07.160559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5392247b23104c5394ec61c77fb1fb61)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:07.162775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:07.405658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5392247b23104c5394ec61c77fb1fb61'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.405932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5392247b23104c5394ec61c77fb1fb61'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.406573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5392247b23104c5394ec61c77fb1fb61'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.413845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5392247b23104c5394ec61c77fb1fb61'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.415784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:07.426778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-80d17e31-3d44-4a6d-af19-72d1d61c0642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5392247b23104c5394ec61c77fb1fb61'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:07.515468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1169/2321] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:12:07 2022] DELETE /identity/v3/users/5392247b23104c5394ec61c77fb1fb61 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:12:07.948431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:07.950538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:07.982963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947e487-6f6a-4bd8-a84f-fc813f20c03b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:08.052106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:08.053008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:08.053288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:08.054041 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] PATH_INFO: `/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:08.055234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=129ec7a11bbf416b8bc40b66c6f6f63d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:08.057979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:08.088879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:08.179078 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129ec7a11bbf416b8bc40b66c6f6f63d', 'request_id': 'req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:08.186226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129ec7a11bbf416b8bc40b66c6f6f63d', 'request_id': 'req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:08.275301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129ec7a11bbf416b8bc40b66c6f6f63d', 'request_id': 'req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:08.292426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] The token cache is being invalidate because project 129ec7a11bbf416b8bc40b66c6f6f63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:12:08.292601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:08.293505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:08.303112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1153/2322] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:12:07 2022] DELETE /identity/v3/projects/129ec7a11bbf416b8bc40b66c6f6f63d => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:09.261404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc524-f63f-486f-a728-f05081f91029 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:09.261961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc524-f63f-486f-a728-f05081f91029 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:09.261961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082dc524-f63f-486f-a728-f05081f91029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:09.280153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-082dc524-f63f-486f-a728-f05081f91029 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:09.281385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-082dc524-f63f-486f-a728-f05081f91029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:09.348132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1170/2323] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:09.382805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:09.384417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:09.469993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf8a7f-3c92-440a-af9b-2f404f7d97d1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:09.472383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:09.473246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:09.473496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:09.473782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:09.484511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:09.486110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a87150-dcd0-45d7-8562-d02dc9481d55 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:09.498959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1154/2324] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:09.816877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc524-f63f-486f-a728-f05081f91029 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:09.818507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-082dc524-f63f-486f-a728-f05081f91029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:09.834653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082dc524-f63f-486f-a728-f05081f91029 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:09.841560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:09.842518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:09.842810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:09.843534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] PATH_INFO: `/v3/users/e16aff8d5b7b4ebb85d301494c4589ac` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:09.844889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16aff8d5b7b4ebb85d301494c4589ac)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:09.847184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:10.049518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16aff8d5b7b4ebb85d301494c4589ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.050180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16aff8d5b7b4ebb85d301494c4589ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.050792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16aff8d5b7b4ebb85d301494c4589ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.057940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16aff8d5b7b4ebb85d301494c4589ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.070635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16aff8d5b7b4ebb85d301494c4589ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.127692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1171/2325] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:12:09 2022] DELETE /identity/v3/users/e16aff8d5b7b4ebb85d301494c4589ac => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:12:10.133891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:10.133891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:10.133891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:10.151898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:10.153129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:10.228070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1155/2326] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:10.240801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:10.242325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:10.303259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:10.307833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e69fa-1d84-41ab-af53-7b1202e724e4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:10.311569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:10.312240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:10.312530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:10.312812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:10.322058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:10.323550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b002e5c-a00c-4363-966c-eb47161ff4e7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:10.333795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1172/2327] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:10.745130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:10.746951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:10.762063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e43893-f7b4-43ba-a60d-2e288dcddef3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:10.767601 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:10.768473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:10.768935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:10.769213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] PATH_INFO: `/v3/projects/37aa9863b7a4432c97debb5eb3a32f1e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:10.770604 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37aa9863b7a4432c97debb5eb3a32f1e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:10.772553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:10.867589 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:10.883684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37aa9863b7a4432c97debb5eb3a32f1e', 'request_id': 'req-b0458a94-168e-4102-b09d-63741b357d51'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.892443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37aa9863b7a4432c97debb5eb3a32f1e', 'request_id': 'req-b0458a94-168e-4102-b09d-63741b357d51'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.978108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37aa9863b7a4432c97debb5eb3a32f1e', 'request_id': 'req-b0458a94-168e-4102-b09d-63741b357d51'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.991008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] The token cache is being invalidate because project 37aa9863b7a4432c97debb5eb3a32f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:12:10.991296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.991962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b0458a94-168e-4102-b09d-63741b357d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:10.993587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1156/2328] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:12:10 2022] DELETE /identity/v3/projects/37aa9863b7a4432c97debb5eb3a32f1e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:10.998911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:10.999277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:10.999578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.018618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:11.020174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:11.091264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1173/2329] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:11.099167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.099484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.099790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.120293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:11.121513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:11.129322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1157/2330] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:11.134274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.143747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483daa33-f01f-415f-b2e3-a095dd3dd89b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.148357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.149010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.149298 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.149580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.150306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:12:11.151138 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.152621 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.165171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1174/2331] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:12:11.171778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.181151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0374f-08ff-4495-87ba-475b9ce1c363 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.186764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.187419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.187737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.188016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.188731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.190635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.309975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1158/2332] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:12:11 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:12:11.314018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.326170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a335e-464c-4251-aa16-251d414700d3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.397115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.397898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.398184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.398483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.399190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.402236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.491605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1175/2333] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:12:11 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:12:11.496178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.506525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da970bb-ec16-481f-82b9-57dee973aab6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.512232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.513059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.513344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.513644 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.514371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.516024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.527649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1159/2334] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:12:11.531598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.542266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb567-e753-4442-af08-352157cda93e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.547181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.547948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.548238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.548519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.549256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.550833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c02498-4dae-4f70-bb7f-ee42ad41c740 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.562348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1176/2335] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:12:11.566590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.577557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce86254-e531-4706-aace-19c44b41e090 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.582229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.583110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.583396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.583934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] PATH_INFO: `/v3/projects/f27fe30450b94ba38fb95caf00eb04a1/users/5dfc6abb51aa408aa8e38ffd72e04f15/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.599136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f27fe30450b94ba38fb95caf00eb04a1, user_id=5dfc6abb51aa408aa8e38ffd72e04f15, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.601818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.674521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1160/2336] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:12:11 2022] PUT /identity/v3/projects/f27fe30450b94ba38fb95caf00eb04a1/users/5dfc6abb51aa408aa8e38ffd72e04f15/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:11.686251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45feed6-6aed-4546-920b-6cecc403fdad None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.686542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45feed6-6aed-4546-920b-6cecc403fdad None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.686827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45feed6-6aed-4546-920b-6cecc403fdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.713657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b45feed6-6aed-4546-920b-6cecc403fdad None None] MFA Rules not processed for user `5dfc6abb51aa408aa8e38ffd72e04f15`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:11.714858 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b45feed6-6aed-4546-920b-6cecc403fdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:11.766494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:11.787376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1177/2337] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:11.798664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:11.800765 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:11.861678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60dc00-1bdc-430c-b442-d6fc440e0a9c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:11.865453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:11.866121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:11.866403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:11.866680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:11.876299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:11.877750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:11.888649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1161/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:15.559180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea95-9b37-46fa-9b7f-183bb0f52692 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:15.560067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea95-9b37-46fa-9b7f-183bb0f52692 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:15.560067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301ea95-9b37-46fa-9b7f-183bb0f52692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:15.577752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3301ea95-9b37-46fa-9b7f-183bb0f52692 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:15.578949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3301ea95-9b37-46fa-9b7f-183bb0f52692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:15.654039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1178/2339] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:15.697633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:15.700617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:15.760346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:15.778457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654325f-b02b-4af6-b251-27659690694f service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:15.784266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:15.784890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:15.785186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:15.785470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:15.793828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:15.795413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:15.805005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1162/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:24.431440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:24.432012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:24.432012 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:24.458650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:24.458650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:24.467189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1179/2341] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:24.503504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:24.506815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42f8e5-e575-4abf-a59c-f85540f5cbf3 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:24.512819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:24.513474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:24.513763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:24.514046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:24.522821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:24.524470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218a3948-37e1-4fc3-8fed-a67bb9582b4d service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:24.534630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1163/2342] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:26.786882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:26.797822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7756-c76d-4b71-912e-f4200445ef30 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:26.803345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:26.804397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:26.804746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:26.805092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] PATH_INFO: `/v3/users/5dfc6abb51aa408aa8e38ffd72e04f15` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:26.806532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dfc6abb51aa408aa8e38ffd72e04f15)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:26.808586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:27.041372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dfc6abb51aa408aa8e38ffd72e04f15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:27.042657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dfc6abb51aa408aa8e38ffd72e04f15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:27.043282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dfc6abb51aa408aa8e38ffd72e04f15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:27.055365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dfc6abb51aa408aa8e38ffd72e04f15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:27.067880 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b23e65fc-0d56-46cb-8fa4-0533488071ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dfc6abb51aa408aa8e38ffd72e04f15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:27.173889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1180/2343] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:12:26 2022] DELETE /identity/v3/users/5dfc6abb51aa408aa8e38ffd72e04f15 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:27.179092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:27.179974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:27.180282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:27.202269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:27.204112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:27.276489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:27.277016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:27.277559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1164/2344] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:27.278073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:27.291443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:27.293033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:27.304413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] MFA Rules not processed for user `c506fffb10d842069208a92e6f9f778b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:27.306280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:27.371494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a1764-80b0-4add-a78b-cdf1582fe5c6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:27.376294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:27.377012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:27.377297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:27.377574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:27.380177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:27.390928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:27.392814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b224a-3e72-4c6c-9532-ff311ec36d2e service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:27.398106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1181/2345] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:12:27.411629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1165/2346] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:28.151864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:28.153988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:28.170837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18551bc-6e50-4ed6-adc0-4e6e9c8d5578 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:28.179094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:28.180269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:28.180557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:28.180994 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] PATH_INFO: `/v3/projects/f27fe30450b94ba38fb95caf00eb04a1` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:28.182490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f27fe30450b94ba38fb95caf00eb04a1)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:28.185161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:28.351498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f27fe30450b94ba38fb95caf00eb04a1', 'request_id': 'req-2497c516-cce1-4fc2-aee1-b03e6638441a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:28.365943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f27fe30450b94ba38fb95caf00eb04a1', 'request_id': 'req-2497c516-cce1-4fc2-aee1-b03e6638441a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:28.458214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f27fe30450b94ba38fb95caf00eb04a1', 'request_id': 'req-2497c516-cce1-4fc2-aee1-b03e6638441a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:28.480623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] The token cache is being invalidate because project f27fe30450b94ba38fb95caf00eb04a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:12:28.481416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:28.482288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:12:28.484987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1182/2347] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:12:28 2022] DELETE /identity/v3/projects/f27fe30450b94ba38fb95caf00eb04a1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:12:28.693686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675eb99-e29a-468b-afcd-3d2c756cdca9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:28.694141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675eb99-e29a-468b-afcd-3d2c756cdca9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:28.694233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675eb99-e29a-468b-afcd-3d2c756cdca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:28.745971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f675eb99-e29a-468b-afcd-3d2c756cdca9 None None] MFA Rules not processed for user `f5464624509844deaac583112045530c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:28.747760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f675eb99-e29a-468b-afcd-3d2c756cdca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:28.887720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1166/2348] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:12:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:29.869484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:29.871483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:29.954615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497c516-cce1-4fc2-aee1-b03e6638441a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:29.959929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:29.960592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:29.960879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:29.961160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:29.963191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:29.975847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:29.986243 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:29.989028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1183/2349] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:12:30.221663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4c73-1cbd-40aa-82f1-c10b0b8ccd1c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:30.224335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4c73-1cbd-40aa-82f1-c10b0b8ccd1c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:30.224335 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d4c73-1cbd-40aa-82f1-c10b0b8ccd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:30.258366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ce5d4c73-1cbd-40aa-82f1-c10b0b8ccd1c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:30.259595 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ce5d4c73-1cbd-40aa-82f1-c10b0b8ccd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:30.275396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:30.322050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1167/2350] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:12:30.344984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:30.346380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:30.421041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3db574-c76e-4896-9104-2112fd8650c9 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:30.426667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:30.427321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:30.427641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:30.427922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:30.434158 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:12:30.436641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:30.438869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:30.448752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1184/2351] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:35.530389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f319bd-7184-421a-8777-4f075fdc1d7c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:35.530910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f319bd-7184-421a-8777-4f075fdc1d7c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:35.531046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f319bd-7184-421a-8777-4f075fdc1d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:35.551919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e2f319bd-7184-421a-8777-4f075fdc1d7c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:35.553186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e2f319bd-7184-421a-8777-4f075fdc1d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:35.561334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1168/2352] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:35.596047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:35.609046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356e5e4-7110-4319-a05c-20d4ff9e4c81 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:35.619231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:35.619923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:35.620239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:35.620521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:35.629679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:35.631244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:35.641985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1185/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:42.881594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4bf24-1b60-43b3-bf45-d21c38c94c17 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:42.882118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4bf24-1b60-43b3-bf45-d21c38c94c17 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:42.882216 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4bf24-1b60-43b3-bf45-d21c38c94c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:42.901493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a4b4bf24-1b60-43b3-bf45-d21c38c94c17 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:42.905928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a4b4bf24-1b60-43b3-bf45-d21c38c94c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:42.911627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1169/2354] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:42.944608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:42.956631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684fe03-0819-4992-a036-29f77b19f0d4 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:42.963620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:42.964271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:42.964553 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:42.964827 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:42.974405 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:42.976505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:42.986866 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1186/2355] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:12:50.935890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603743d-08e8-46b5-8334-7c64553ca7ae None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:50.936347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603743d-08e8-46b5-8334-7c64553ca7ae None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:50.936437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603743d-08e8-46b5-8334-7c64553ca7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:50.955292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8603743d-08e8-46b5-8334-7c64553ca7ae None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:12:50.956660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8603743d-08e8-46b5-8334-7c64553ca7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:51.014780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1170/2356] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:12:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:12:51.066124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:12:51.070075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:12:51.145429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485d990-a2ac-457a-a77d-7a7eca0f061d service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:12:51.151171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:12:51.151865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:12:51.152150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:12:51.152428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:12:51.165461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:12:51.165461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:12:51.172679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1187/2357] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:12:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:13:00.963193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a390-5157-4d8b-95e2-eca52fb48a7e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:00.963193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a390-5157-4d8b-95e2-eca52fb48a7e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:00.963193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82a390-5157-4d8b-95e2-eca52fb48a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:00.965746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=50 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:00.979244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3a82a390-5157-4d8b-95e2-eca52fb48a7e None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:00.980536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3a82a390-5157-4d8b-95e2-eca52fb48a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:00.988334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1171/2358] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:13:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:13:01.001239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:01.007749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=47 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:01.017310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028de84-7295-49bb-a140-460b055a2352 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:01.030959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:01.031658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:01.043798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:01.043798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:01.043798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:01.043798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188c6be-a8ec-4989-954a-8dc62658fe8b service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:01.053743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1188/2359] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:13:10.079642 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.080690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.081993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.084100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1172/2360] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:13:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:13:10.090818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2efc-354a-44b4-9b0c-b8a9cdb5d53a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.091863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2efc-354a-44b4-9b0c-b8a9cdb5d53a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.092307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea2efc-354a-44b4-9b0c-b8a9cdb5d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.125132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b7ea2efc-354a-44b4-9b0c-b8a9cdb5d53a None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:10.127201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b7ea2efc-354a-44b4-9b0c-b8a9cdb5d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.145813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1189/2361] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:10.153799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:10.157027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.236966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0c256-bdaf-4500-b161-80e1f6638878 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:10.254795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:10.256692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.256692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.257106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.270114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:10.271627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9f19cc-c0da-4ea8-81e5-49bd4fb66d20 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:10.283452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1173/2362] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:13:10.523517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.524214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.524696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.547165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] MFA Rules not processed for user `0d88930ae012493892c8e14f36d6a034`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:10.548477 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.569828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f1f4-e657-4a0c-a480-9a7d7918e193 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.570187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f1f4-e657-4a0c-a480-9a7d7918e193 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.570479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f1f4-e657-4a0c-a480-9a7d7918e193 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.572115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1174/2363] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 25 06:13:10.579223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf797d6-8072-405a-82c9-03510e4133a4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.579223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf797d6-8072-405a-82c9-03510e4133a4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.579223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf797d6-8072-405a-82c9-03510e4133a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.626151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1190/2364] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:10.628710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-adf797d6-8072-405a-82c9-03510e4133a4 None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:10.629956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-adf797d6-8072-405a-82c9-03510e4133a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.725028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1175/2365] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:13:10.725877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:10.725877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.752331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e0335-6e14-411f-a75b-b29654673d34 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:10.752331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:10.753439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.753696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.753980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.762583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:10.764054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e5f74-c461-4495-a85b-ee5fda8f9540 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:10.772488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1191/2366] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:13:10.858836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573083eb-85a6-416e-9265-f1824a503439 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.862827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573083eb-85a6-416e-9265-f1824a503439 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.862827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573083eb-85a6-416e-9265-f1824a503439 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.862827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1176/2367] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:13:10.866632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d042-3bcb-4c3f-b001-977989c82bb7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.866929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d042-3bcb-4c3f-b001-977989c82bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.867207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355d042-3bcb-4c3f-b001-977989c82bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.887208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3355d042-3bcb-4c3f-b001-977989c82bb7 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:10.888222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3355d042-3bcb-4c3f-b001-977989c82bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:10.898965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1192/2368] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:13:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:10.910016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573083eb-85a6-416e-9265-f1824a503439 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:10.921607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573083eb-85a6-416e-9265-f1824a503439 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:10.925857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:10.926536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:10.926831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:10.927119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:10.938829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:10.941192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:10.953741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1177/2369] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:13:15.590906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f59ac-1ffc-44b0-ab93-bedea1098404 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:15.593793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f59ac-1ffc-44b0-ab93-bedea1098404 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:15.593793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f59ac-1ffc-44b0-ab93-bedea1098404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:15.612839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-132f59ac-1ffc-44b0-ab93-bedea1098404 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:15.614807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-132f59ac-1ffc-44b0-ab93-bedea1098404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:15.622705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1193/2370] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:13:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:15.640029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:15.656857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef095d-1acc-4a66-9f8d-2fbda6b5ba58 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:15.664012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:15.665178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:15.665700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:15.666212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:15.676777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:15.678779 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:15.688685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1178/2371] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:13:19.834963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:19.835678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:19.835678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:19.868475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:19.869863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:19.882820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1194/2372] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:13:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:19.901773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:19.913009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1eb3b5-d4d3-4aa1-b359-16ca42a877aa service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:19.918938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:19.919621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:19.919913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:19.920196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:19.928715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:19.930923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:19.942062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1179/2373] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:13:23.590484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:23.605556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:23.607173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebee1db-d635-4ac1-8520-eeb6accb1b85 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:23.611819 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:23.612705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:23.612991 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:23.613269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] PATH_INFO: `/v3/users/c506fffb10d842069208a92e6f9f778b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:23.614484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c506fffb10d842069208a92e6f9f778b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:23.616455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:23.821231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c506fffb10d842069208a92e6f9f778b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:23.821902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c506fffb10d842069208a92e6f9f778b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:23.822503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c506fffb10d842069208a92e6f9f778b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:23.831712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c506fffb10d842069208a92e6f9f778b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:23.851260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-84137272-9cf3-47d0-876d-0487ddb86314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c506fffb10d842069208a92e6f9f778b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.153838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1195/2374] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:13:23 2022] DELETE /identity/v3/users/c506fffb10d842069208a92e6f9f778b => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:13:24.467222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:24.480199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08cb47-d46b-4714-9d3e-fbe77c75b93c service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:24.560717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:24.563208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:24.563208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:24.563208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] PATH_INFO: `/v3/projects/c04fcd6058244df586e8bbbd8edecbb7` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:24.568358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04fcd6058244df586e8bbbd8edecbb7)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:24.570718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:24.583878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:24.669544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04fcd6058244df586e8bbbd8edecbb7', 'request_id': 'req-335bd19a-f4f1-4537-b1ff-7d3367f390aa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.675105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04fcd6058244df586e8bbbd8edecbb7', 'request_id': 'req-335bd19a-f4f1-4537-b1ff-7d3367f390aa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.740227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04fcd6058244df586e8bbbd8edecbb7', 'request_id': 'req-335bd19a-f4f1-4537-b1ff-7d3367f390aa'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.753309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] The token cache is being invalidate because project c04fcd6058244df586e8bbbd8edecbb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:13:24.753603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.754455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-335bd19a-f4f1-4537-b1ff-7d3367f390aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:13:24.756049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1180/2375] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:13:24 2022] DELETE /identity/v3/projects/c04fcd6058244df586e8bbbd8edecbb7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:13:24.761018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:24.761529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:24.761632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:24.780702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:24.781910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:24.805796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:24.860538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1196/2376] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:24.869399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:24.869717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:24.869968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:24.891115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:24.892361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:24.900299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1181/2377] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:24.904527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:24.915026 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0ded0d-eb7c-4fe1-ba75-854b088a8ce9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:24.920692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:24.921302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:24.921587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:24.921864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:24.922628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:13:24.922938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:24.924574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:24.947044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1197/2378] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:13:24.948094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:24.957901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c896eee-494f-43a0-9a03-68aa95ae0e8d None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:24.962724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:24.963389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:24.963714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:24.963994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:24.964680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:24.966575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.241154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1182/2379] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:13:24 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:13:25.243166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:25.253822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e6a6d-63b5-45e6-8cc1-68f9632d854a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:25.347167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:25.347907 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.348199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.348612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.349483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:25.351706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.466971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1198/2380] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:13:25 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:13:25.471125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:25.485359 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e4f30-2549-4775-b596-0c0fbbcfdbd7 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:25.490302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:25.490935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.491214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.491505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.492267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:25.493902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.504820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1183/2381] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:13:25.508999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:25.519527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabdb62-31e0-44c3-8575-5ffde9e154e7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:25.525264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:25.525976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.526296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.526571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.527341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:25.529302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c28bc-0397-4a60-8263-4e8021f7c13f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.541779 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1199/2382] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:13:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:13:25.545780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:25.558307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45582a7f-2000-4bc0-8e0e-ba1ebbd73e0a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:25.564759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:25.565832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.566116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.566911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] PATH_INFO: `/v3/projects/31c4fa76a6f2444093744c86f01560f8/users/dbcaa0e9f9f04b348ed2dc5f071de4b9/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.589154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c4fa76a6f2444093744c86f01560f8, user_id=dbcaa0e9f9f04b348ed2dc5f071de4b9, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:25.597882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.676431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1184/2383] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:13:25 2022] PUT /identity/v3/projects/31c4fa76a6f2444093744c86f01560f8/users/dbcaa0e9f9f04b348ed2dc5f071de4b9/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:13:25.682106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d7cf-4d7a-493e-99b5-6e9a321a4e8f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.684800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d7cf-4d7a-493e-99b5-6e9a321a4e8f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.684800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902d7cf-4d7a-493e-99b5-6e9a321a4e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.701990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8902d7cf-4d7a-493e-99b5-6e9a321a4e8f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:25.703263 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8902d7cf-4d7a-493e-99b5-6e9a321a4e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:25.789591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1200/2384] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:25.799228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:25.801541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:25.860089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386b457-f721-4785-8c11-1c5696165de2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:25.863729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:25.867901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:25.867901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:25.867901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:25.873861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:25.875453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:25.888098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1185/2385] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:13:31.394963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:31.395636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:31.395756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:31.428996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] MFA Rules not processed for user `dbcaa0e9f9f04b348ed2dc5f071de4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:31.434187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:31.456469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:31.504483 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1201/2386] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:31.509376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:31.520061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53918bc-af16-48e1-9191-3e21071138cc service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:31.525615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:31.526386 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:31.526683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:31.530324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:31.531213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:31.533034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:31.619665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1186/2387] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:13:31 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:13:31.623738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:31.635392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b275e-e8bc-435a-82c4-2a93f12b00a8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:31.696660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:31.697315 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:31.697603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:31.697881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:31.698568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:31.700527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:31.812355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1202/2388] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:13:31 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:13:31.816403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:31.827475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127524ce-23a7-4450-8d7a-8fc19cde965a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:31.831992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:31.832652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:31.833015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:31.833220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:31.833940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:31.835519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:31.846221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1187/2389] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:13:31.850496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:31.868292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa521cec-1eab-4501-ad77-d9bc975439cb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:31.868292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:31.868292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:31.868696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:31.868696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] PATH_INFO: `/v3/projects/f694600ad0d5459fb000ca3181218826/users/73da7b1d535a4c43ac941376a8e0320a/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:31.885065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f694600ad0d5459fb000ca3181218826, user_id=73da7b1d535a4c43ac941376a8e0320a, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:31.888014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:31.951411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1203/2390] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:13:31 2022] PUT /identity/v3/projects/f694600ad0d5459fb000ca3181218826/users/73da7b1d535a4c43ac941376a8e0320a/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:13:31.955272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:31.962616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:31.966523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9f7c8-fee1-4db5-a941-2b687746c72a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:32.024300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:32.024980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:32.025264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:32.025540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:32.026264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:32.027890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902bdf10-096f-4255-90e6-2b2c0dd25937 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:32.040351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1188/2391] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:13:32.044780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:32.055783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50252303-40bf-4218-bbb1-df940fbfda9c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:32.060690 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:32.061574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:32.061864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:32.062143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] PATH_INFO: `/v3/projects/f694600ad0d5459fb000ca3181218826/users/73da7b1d535a4c43ac941376a8e0320a/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:32.064186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f694600ad0d5459fb000ca3181218826, user_id=73da7b1d535a4c43ac941376a8e0320a, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:32.066857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:32.078167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1204/2392] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:13:32 2022] PUT /identity/v3/projects/f694600ad0d5459fb000ca3181218826/users/73da7b1d535a4c43ac941376a8e0320a/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:13:38.455514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e96a92-e625-4008-9802-ddd4efa9ab96 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:38.456059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e96a92-e625-4008-9802-ddd4efa9ab96 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:38.456148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e96a92-e625-4008-9802-ddd4efa9ab96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:38.501688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b2e96a92-e625-4008-9802-ddd4efa9ab96 None None] MFA Rules not processed for user `73da7b1d535a4c43ac941376a8e0320a`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:38.503151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b2e96a92-e625-4008-9802-ddd4efa9ab96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:38.601726 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1189/2393] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:38.614174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:38.615950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:38.681129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2be31-e609-4281-aa32-b3f6b860b723 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:38.684920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:38.685571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:38.685854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:38.686128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:38.716676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:38.746777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:38.748200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:38.758313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1205/2394] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:13:39.038332 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab09a8-f792-4109-b93b-39e031a45335 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:39.038703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab09a8-f792-4109-b93b-39e031a45335 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:39.038991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab09a8-f792-4109-b93b-39e031a45335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:39.059261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-09ab09a8-f792-4109-b93b-39e031a45335 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:39.060896 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-09ab09a8-f792-4109-b93b-39e031a45335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:39.131394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1190/2395] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:13:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:39.148257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:39.150902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:39.250403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ede95-2f5a-47b1-82a4-4d93d016010c service glance] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:39.256261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:39.256932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:39.257305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:39.257607 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:39.269314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:39.270935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:39.281362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1206/2396] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:13:42.305504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffa1b-dd5a-4c43-b5d5-003df8d930c8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:42.306655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffa1b-dd5a-4c43-b5d5-003df8d930c8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:42.306998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ffa1b-dd5a-4c43-b5d5-003df8d930c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:42.338619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-765ffa1b-dd5a-4c43-b5d5-003df8d930c8 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:42.363309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-765ffa1b-dd5a-4c43-b5d5-003df8d930c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:42.363309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1191/2397] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:13:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:42.366011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:42.377842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a963eccc-1e2a-4311-8122-2ea80b26bf6a service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:42.382937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:42.383665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:42.383957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:42.384238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:42.393068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:42.394636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:42.404125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1207/2398] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:13:49.762382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc777db6-e289-43b6-843d-5b41b4373e8f None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:49.763167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc777db6-e289-43b6-843d-5b41b4373e8f None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:49.763167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc777db6-e289-43b6-843d-5b41b4373e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:49.781468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-cc777db6-e289-43b6-843d-5b41b4373e8f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:49.782818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cc777db6-e289-43b6-843d-5b41b4373e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:49.802120 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:13:49.843772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1192/2399] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:49.863683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:49.865606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:49.945283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d82a8b-bd0f-4b0f-a958-27846a04d9e4 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:49.951446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:49.952127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:49.952408 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:49.952714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:49.961799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:49.963432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa7b155-cac5-4f75-86b8-257b70b5197e service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:49.973328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1208/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:13:50.064147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655786ed-7273-4d44-9370-2fd84108c836 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:50.064462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655786ed-7273-4d44-9370-2fd84108c836 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:50.064748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655786ed-7273-4d44-9370-2fd84108c836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:50.082477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-655786ed-7273-4d44-9370-2fd84108c836 None None] MFA Rules not processed for user `dbcaa0e9f9f04b348ed2dc5f071de4b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:50.084019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-655786ed-7273-4d44-9370-2fd84108c836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:50.091812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1193/2401] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:13:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:54.197450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:54.197932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:54.198212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:54.203490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:54.204480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:54.204850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:54.218175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:54.219850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:54.225356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:13:54.226547 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:54.230488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1209/2402] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:54.234898 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1194/2403] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:13:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:13:54.251494 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:54.254865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:13:54.261890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:13:54.269708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5409e920-9603-425e-9f3a-191c895cb87b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:54.274982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b67e25-ba7c-4de4-8205-52a818a5333c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:13:54.275331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:54.276007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:54.276307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:54.276573 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:54.280584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:13:54.281422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:13:54.281884 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:13:54.282327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:13:54.286169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:54.289564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327830b-a493-4c52-85e8-c93a5f6e436b service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:54.292665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:13:54.294306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:13:54.298377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1210/2404] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:13:54.302992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1195/2405] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:13:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:14:04.294094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:04.299471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=28 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:12.563528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed559-581a-41d7-beb3-080571f16ddb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:12.564065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed559-581a-41d7-beb3-080571f16ddb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:12.564161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed559-581a-41d7-beb3-080571f16ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:12.583042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-11bed559-581a-41d7-beb3-080571f16ddb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:14:12.587499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-11bed559-581a-41d7-beb3-080571f16ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:12.593094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1211/2406] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:14:12.618438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:12.630698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a210-da83-4b80-aed8-a54c3201d391 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:12.636184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:12.637151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:12.637423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:12.637701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:12.646148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:12.647737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:12.658044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1196/2407] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:18.914420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086fb7-8490-4668-b673-60ca279fc4ae None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:18.914909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086fb7-8490-4668-b673-60ca279fc4ae None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:18.915193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5086fb7-8490-4668-b673-60ca279fc4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:18.935076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d5086fb7-8490-4668-b673-60ca279fc4ae None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:14:18.936323 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d5086fb7-8490-4668-b673-60ca279fc4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:18.945066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1212/2408] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:14:18.966234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:18.978628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adbd7b-b93c-4537-89c5-29c2e8d23e15 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:18.985204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:18.985852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:18.986141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:18.986417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:18.995360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:18.997526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:19.007682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1197/2409] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:26.249227 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:26.249711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:26.249817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:26.268531 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:14:26.269730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:26.278407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1213/2410] 10.222.0.18 () {58 vars in 1016 bytes} [Mon Jul 25 06:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:14:26.300573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:26.312351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed232279-9942-431d-a648-e0e1a9c3f157 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:26.317874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:26.318527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:26.318796 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:26.319076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:26.327248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:26.328846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:26.338109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1198/2411] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:29.883631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:29.939305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d48d81-743c-45be-b320-171d0eaf2c63 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:29.943086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:29.943841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:29.944383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:29.944586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:29.954873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:29.956502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:29.968238 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1214/2412] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:33.617704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:33.629104 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed650d-1bef-4056-bf37-5364706f0a17 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:33.633057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:33.633885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:33.634350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:33.634797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:33.637482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:33.677701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:33.680185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:33.710360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1199/2413] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:34.792717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:34.800306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=36 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:34.807509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5020b-c2c7-4abc-b0c6-4332f0ea01a7 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:34.814007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542157-571b-4dee-be49-2850fa710950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:34.814680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542157-571b-4dee-be49-2850fa710950 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:34.814969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542157-571b-4dee-be49-2850fa710950 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:34.815247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07542157-571b-4dee-be49-2850fa710950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:34.817240 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-07542157-571b-4dee-be49-2850fa710950 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:34.910830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542157-571b-4dee-be49-2850fa710950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:34.912682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07542157-571b-4dee-be49-2850fa710950 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:34.924216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1215/2414] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:38.792615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:38.794798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:38.801032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=25 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:38.805990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f13402-25df-401d-92fa-42d6b3e9ee53 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:38.809881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:38.813112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:38.813112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:38.813112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:38.813112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:38.826985 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:38.828446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094f8a6-1941-45e9-84e1-55486e9f88d1 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:38.840284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1200/2415] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:44.919414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=27 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:46.165568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542157-571b-4dee-be49-2850fa710950 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:46.177933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07542157-571b-4dee-be49-2850fa710950 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:46.184872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:46.185523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:46.185807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:46.186084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:46.187864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:46.247730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:46.249346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:46.258603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1216/2416] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:46.433033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f6a8-0bba-492c-ad61-a985fd269386 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:46.433545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f6a8-0bba-492c-ad61-a985fd269386 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:46.433545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4f6a8-0bba-492c-ad61-a985fd269386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:46.451835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4ff4f6a8-0bba-492c-ad61-a985fd269386 None None] MFA Rules not processed for user `10875af9fd904150ac8baac0a4c83a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:14:46.453070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4ff4f6a8-0bba-492c-ad61-a985fd269386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:46.459957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1201/2417] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:14:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:14:47.575686 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:47.587638 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91706e37-1c30-45d8-b182-ebfb6c82f9a7 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:47.595397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:47.596205 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:47.596959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:47.596959 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:47.599931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:47.677551 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:47.679549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:47.693385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1217/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:56.446999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=8 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:57.687936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=56 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:14:58.112180 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:58.112676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:58.112773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:58.130665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] MFA Rules not processed for user `f5464624509844deaac583112045530c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:14:58.131916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:58.139363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1202/2419] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:14:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:14:58.377284 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:58.387495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d984b65-c154-4917-bf22-57c675c33635 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:58.391523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:58.392288 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:58.392574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:58.392853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:58.394678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:58.406258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:58.407713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:58.415843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1218/2420] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:58.457681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:58.467369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0114d79-bb6c-4676-b7c3-879d0b01d221 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:58.471632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:58.472445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:58.472965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:58.473479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:58.475679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:58.488376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:58.489834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4b4de-d4fd-459d-9478-f691606dcee0 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:58.505172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1203/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:14:59.324029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:14:59.329030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:59.435479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa897ff2-284b-4138-b5d8-ccbea86b866d service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:14:59.438832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:14:59.439504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:14:59.439838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:14:59.440121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:14:59.442151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:14:59.455291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:14:59.464446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:14:59.470084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1219/2422] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:14:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:01.775750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:01.776269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:01.776363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:01.795224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] MFA Rules not processed for user `cb480fa8195647cfa6bcf3c5383b9229`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:15:01.807042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:01.807042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1204/2423] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:15:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:15:02.281965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:02.291825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3fda3-20f5-491b-8143-52f6d39986a2 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:02.296207 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:02.296931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:02.297165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:02.297440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:02.299294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:02.309425 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:02.310853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:02.330520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1220/2424] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:03.763103 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:03.777519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b96f0-9cac-4815-b81f-a1e5dfe23883 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:03.784376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:03.785061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:03.786904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:03.786904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:03.789370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:03.803283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:03.805049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:03.817115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1205/2425] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:09.009613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:09.024875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17c653-83bd-45ee-9c59-d95a3cb717ce service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:09.036259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:09.046348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:09.046659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:09.046944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:09.049150 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:09.063526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:09.065332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:09.092003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1221/2426] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:09.180965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:09.183310 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:09.198131 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eb6cb-9fd1-4aec-86e1-18d3957e8fef service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:09.204482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:09.205553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:09.205905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:09.206191 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] PATH_INFO: `/v3/users/0d88930ae012493892c8e14f36d6a034` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:09.207432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d88930ae012493892c8e14f36d6a034)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:09.209399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:09.460636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d88930ae012493892c8e14f36d6a034'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:09.477021 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d88930ae012493892c8e14f36d6a034'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:09.539318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d88930ae012493892c8e14f36d6a034'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:09.547711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d88930ae012493892c8e14f36d6a034'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:09.548378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45dea2a7-59e0-4a08-b4a5-d9bd0057a6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d88930ae012493892c8e14f36d6a034'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:09.554340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1206/2427] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:15:09 2022] DELETE /identity/v3/users/0d88930ae012493892c8e14f36d6a034 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:15:09.848450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:09.860359 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454e7a0-c3e5-4d5c-85b0-4bd573d8884c service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:09.930982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:09.931881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:09.932167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:09.932446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] PATH_INFO: `/v3/projects/6a74af209324471795c15c7785d09056` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:09.933632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a74af209324471795c15c7785d09056)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:09.936214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.060267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a74af209324471795c15c7785d09056', 'request_id': 'req-d1ac76aa-e003-4fdf-891b-2097c413f15a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:10.064340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:15:10.067213 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a74af209324471795c15c7785d09056', 'request_id': 'req-d1ac76aa-e003-4fdf-891b-2097c413f15a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:10.133618 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a74af209324471795c15c7785d09056', 'request_id': 'req-d1ac76aa-e003-4fdf-891b-2097c413f15a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:10.147813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] The token cache is being invalidate because project 6a74af209324471795c15c7785d09056 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:15:10.148166 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:10.148856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ac76aa-e003-4fdf-891b-2097c413f15a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:10.150471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1222/2428] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:15:09 2022] DELETE /identity/v3/projects/6a74af209324471795c15c7785d09056 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:15:10.156520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.156899 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.158417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.176426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:15:10.177624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:10.241034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1207/2429] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:15:10.253468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.253892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.256388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.273395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:15:10.274602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:10.288617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1223/2430] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:15:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:15:10.292829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.303452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93c09-b03d-4c14-9d9c-dba30aa310f3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.308336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.313316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.323750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1208/2431] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:15:10.328222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.337418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5ad8b-4027-462b-9acd-324db6824aca None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.342773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.343422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.343743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.344024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.344711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.346620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.437515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1224/2432] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:15:10 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:15:10.441560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.452284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c9ed4-bdc2-49d6-8f9b-24c97f93105e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.469684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:15:10.508692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.509468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.509756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.510037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.510767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.512856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.585454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1209/2433] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:15:10 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:15:10.589580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.600325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bb4b1-6f8e-43f5-ad6a-166f92e3ba13 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.605093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.606321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.606713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.607099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.607865 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.609496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.620871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1225/2434] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:15:10.626049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.636412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d8c24-8b40-4086-b9f9-c5048844ece0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.642619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.643849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.644368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.644652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.645385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.646987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cad73-196f-46f1-aece-66c63851447d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.658019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1210/2435] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:15:10.662249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.673753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893760-d3d7-404a-826f-c478790dec8c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.678192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.679075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.681050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.681050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] PATH_INFO: `/v3/projects/1ab980c68c604b14a46108288e2a651c/users/cfac3b637855474e9483c243a3159597/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.696172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab980c68c604b14a46108288e2a651c, user_id=cfac3b637855474e9483c243a3159597, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.698774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.763183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1226/2436] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:15:10 2022] PUT /identity/v3/projects/1ab980c68c604b14a46108288e2a651c/users/cfac3b637855474e9483c243a3159597/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:15:10.773838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.774134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.774422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.804204 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] MFA Rules not processed for user `cfac3b637855474e9483c243a3159597`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:15:10.805434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:10.873639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1211/2437] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:15:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:15:10.884331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:10.886042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:10.946445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60473efe-e6fd-4328-b4d4-028267b7eec8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:10.950637 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:10.956416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:10.956416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:10.956416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:10.960784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:10.962209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:10.975330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1227/2438] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:13.566184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:13.567672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:13.647509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c4068-becd-4884-9467-c16d086a38b9 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:13.653768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:13.654467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:13.654757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:13.655042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:13.656891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:13.669786 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:13.671478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:13.682266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1212/2439] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:16.972114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:16.985246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd768b-2f82-413c-8a92-ae161ab8c6fb service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:16.990645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:16.991309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:16.991633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:16.991917 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:16.993732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:17.006615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:17.010832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323984-f341-40c8-8e31-c9a86a725254 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:17.020271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1228/2440] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:22.537189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:22.550802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:15:22.599339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6afef-642b-4853-9ec0-41ed46fd64c1 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:22.604016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:22.604907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:22.605272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:22.605534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] PATH_INFO: `/v3/users/cfac3b637855474e9483c243a3159597` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:22.607253 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfac3b637855474e9483c243a3159597)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:22.609283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:22.769213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfac3b637855474e9483c243a3159597'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:22.781875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfac3b637855474e9483c243a3159597'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:22.842085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfac3b637855474e9483c243a3159597'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:22.849309 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfac3b637855474e9483c243a3159597'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:22.849951 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfac3b637855474e9483c243a3159597'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:22.856001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1213/2441] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:15:22 2022] DELETE /identity/v3/users/cfac3b637855474e9483c243a3159597 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:15:22.860600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:22.861038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:22.862761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:22.878518 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:15:22.879748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:22.940486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1229/2442] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:15:22.951063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:22.952471 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:23.008331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b0bd0-8b16-4c4f-b278-6140df8322c5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:23.012575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:23.013207 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:23.013739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:23.014026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:23.022973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:23.024429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:23.034841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1214/2443] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:15:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:15:23.454828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:15:23.456307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:15:23.468706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10bb20-b827-456e-a736-1ce3f5132363 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:15:23.473357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:15:23.474328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:15:23.474620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:15:23.474899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] PATH_INFO: `/v3/projects/1ab980c68c604b14a46108288e2a651c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:15:23.476109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab980c68c604b14a46108288e2a651c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:15:23.478030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:15:23.479924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:15:23.579218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab980c68c604b14a46108288e2a651c', 'request_id': 'req-4c270db0-2b98-470b-ad67-8f2fe3e87071'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:23.584735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab980c68c604b14a46108288e2a651c', 'request_id': 'req-4c270db0-2b98-470b-ad67-8f2fe3e87071'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:23.641441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab980c68c604b14a46108288e2a651c', 'request_id': 'req-4c270db0-2b98-470b-ad67-8f2fe3e87071'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:23.654329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] The token cache is being invalidate because project 1ab980c68c604b14a46108288e2a651c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:15:23.655085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:23.658747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:15:23.658747 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1230/2444] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:15:23 2022] DELETE /identity/v3/projects/1ab980c68c604b14a46108288e2a651c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:15:33.030522 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=73,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:15:33.655291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:16:20.934646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:20.943424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c13a59-e5bd-4582-9c2f-04c73fac584e service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:20.992160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:20.992802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:20.993085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:20.993375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:20.995107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:21.059173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:21.060646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:21.070257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1215/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:16:24.689748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:24.691123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:24.704975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c270db0-2b98-470b-ad67-8f2fe3e87071 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:24.710225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:24.712366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:24.712366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:24.712366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] PATH_INFO: `/v3/users/10875af9fd904150ac8baac0a4c83a73` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:24.712897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10875af9fd904150ac8baac0a4c83a73)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:24.714814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:24.934032 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10875af9fd904150ac8baac0a4c83a73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:24.934728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10875af9fd904150ac8baac0a4c83a73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:24.935372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10875af9fd904150ac8baac0a4c83a73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:24.943918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10875af9fd904150ac8baac0a4c83a73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:24.969727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-36476317-0ce3-462d-9c49-d84be2572841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10875af9fd904150ac8baac0a4c83a73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.036739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1231/2446] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:16:24 2022] DELETE /identity/v3/users/10875af9fd904150ac8baac0a4c83a73 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:16:25.293760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:25.306074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81187daa-9885-4087-a70a-57bd9a4a5ae8 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:25.365747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:25.366608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.366891 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.367185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] PATH_INFO: `/v3/projects/504cd6ee394b4fde991cee6e35cfddc1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.368384 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] RBAC: Authorizing `identity:delete_project(project_id=504cd6ee394b4fde991cee6e35cfddc1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:25.370303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:25.469544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504cd6ee394b4fde991cee6e35cfddc1', 'request_id': 'req-c9202164-d6cc-4f4b-a7bd-52181f93a24e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.471418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:16:25.475847 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504cd6ee394b4fde991cee6e35cfddc1', 'request_id': 'req-c9202164-d6cc-4f4b-a7bd-52181f93a24e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.561724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504cd6ee394b4fde991cee6e35cfddc1', 'request_id': 'req-c9202164-d6cc-4f4b-a7bd-52181f93a24e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.573116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] The token cache is being invalidate because project 504cd6ee394b4fde991cee6e35cfddc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:16:25.573561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.574460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-c9202164-d6cc-4f4b-a7bd-52181f93a24e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:16:25.576027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1216/2447] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:16:25 2022] DELETE /identity/v3/projects/504cd6ee394b4fde991cee6e35cfddc1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:16:25.581219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.581515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.581799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.600490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:25.601695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:25.660577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1232/2448] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:16:25.668645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.669009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.669299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.688287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:25.689484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:25.697456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1217/2449] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:16:25.701507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:25.711921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b797d45d-f694-436c-a8fc-67a4d1a11909 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:25.716645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:25.717303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.717592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.717871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.718601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:16:25.718909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:25.720558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:25.732638 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1233/2450] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:16:25.736908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:25.746080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c33e5fe-0e34-4c39-8724-2550dddd9cca None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:25.750685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:25.751326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.751647 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.751925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.752614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:25.754498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:25.831737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1218/2451] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:16:25 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:16:25.836226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:25.846429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2b8f8-0cc1-4889-a514-92ee7e80ae6e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:25.903629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:25.904301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:25.904591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:25.904874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:25.905560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:25.907469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:25.914175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:16:26.001235 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1234/2452] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:16:25 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:16:26.006286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:26.016936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1fd59-ee6c-4b6e-ace2-fb3a0e988e14 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:26.021618 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:26.022275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:26.022606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:26.022886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:26.023639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:26.025267 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:26.036162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1219/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:16:26.040908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:26.051129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05287fb3-e84b-4a55-a319-6e47645c650e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:26.057597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:26.063978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:26.063978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:26.063978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:26.063978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:26.063978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc650eb-13f0-4dd6-a0a0-1db4cc536fc3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:26.072615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1235/2454] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:16:26.076748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:26.087043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f8c1e-f720-4f1d-90a4-016f4f3b13cb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:26.091705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:26.092587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:26.092873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:26.093156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] PATH_INFO: `/v3/projects/6fba62e6f00d41318359dcda25034608/users/afd54465bfa5482cb252080d845022af/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:26.108571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fba62e6f00d41318359dcda25034608, user_id=afd54465bfa5482cb252080d845022af, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:26.111214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:26.173499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1220/2455] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:16:26 2022] PUT /identity/v3/projects/6fba62e6f00d41318359dcda25034608/users/afd54465bfa5482cb252080d845022af/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:16:26.179525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d778c3-b7cb-4643-964b-8fbc842a33c3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:26.179848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d778c3-b7cb-4643-964b-8fbc842a33c3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:26.180221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d778c3-b7cb-4643-964b-8fbc842a33c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:26.198279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-95d778c3-b7cb-4643-964b-8fbc842a33c3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:26.199476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-95d778c3-b7cb-4643-964b-8fbc842a33c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:26.258585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1236/2456] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:16:26.268466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:26.270195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:26.326692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e584-2689-44f7-9b03-723b3cad32a0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:26.330342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:26.330984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:26.331269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:26.331576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:26.340684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:26.342097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:26.351934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1221/2457] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:16:31.476120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193825-821f-491b-9544-a477f8e8dfcc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:31.477127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193825-821f-491b-9544-a477f8e8dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:31.477649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193825-821f-491b-9544-a477f8e8dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:31.511179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-aa193825-821f-491b-9544-a477f8e8dfcc None None] MFA Rules not processed for user `afd54465bfa5482cb252080d845022af`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:31.512453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aa193825-821f-491b-9544-a477f8e8dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:31.591122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1237/2458] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:16:31.605945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:16:31.610756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:31.726008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d2833-d5a3-478b-9ae8-5ee0c8dbc319 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:16:31.735403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:16:31.736331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:31.736685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:31.737032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:31.746325 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:16:31.747991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16157abf-264f-4448-ab7b-01d74bcbb1ec service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:16:31.758057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1222/2459] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:16:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:16:34.129593 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ec8f-22b4-40db-a2f9-846fe07c18f3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:34.132267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ec8f-22b4-40db-a2f9-846fe07c18f3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:34.132562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ec8f-22b4-40db-a2f9-846fe07c18f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:34.160811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1110ec8f-22b4-40db-a2f9-846fe07c18f3 None None] MFA Rules not processed for user `afd54465bfa5482cb252080d845022af`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:34.166800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1110ec8f-22b4-40db-a2f9-846fe07c18f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:34.200737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1238/2460] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:16:41.753995 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:16:44.148859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:16:44.802961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:16:44.803495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:16:44.803754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:16:44.822361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] MFA Rules not processed for user `f5464624509844deaac583112045530c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:16:44.823853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:16:44.882590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1223/2461] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:16:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:16:54.873881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=25 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:00.973609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721ba7-096e-4aa0-9e41-7f3ad1f71457 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:00.974569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721ba7-096e-4aa0-9e41-7f3ad1f71457 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:00.975367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4721ba7-096e-4aa0-9e41-7f3ad1f71457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:00.995814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d4721ba7-096e-4aa0-9e41-7f3ad1f71457 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:00.997127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d4721ba7-096e-4aa0-9e41-7f3ad1f71457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:01.068070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1239/2462] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:17:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:01.116091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:01.118939 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:01.209318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d582a-83ac-4546-98a3-593a7d3a66cc None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:01.214758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:01.217177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:01.217177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:01.217177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:01.226556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:01.228835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:01.239968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1224/2463] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:17:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:17:11.061457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=25 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:11.236156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=32 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:18.590349 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca3b5-a2c0-439f-bed8-37f445af08d6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:18.590804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca3b5-a2c0-439f-bed8-37f445af08d6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:18.590896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ca3b5-a2c0-439f-bed8-37f445af08d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:18.608424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4c3ca3b5-a2c0-439f-bed8-37f445af08d6 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:18.609616 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4c3ca3b5-a2c0-439f-bed8-37f445af08d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:18.616680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1240/2464] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:17:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:18.629196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:18.640750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d286365-a965-4b39-9f7e-0cbdfce5d405 service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:18.645828 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:18.646475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:18.646760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:18.647040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:18.655238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:18.656879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b1cdb-ba23-4331-b98a-31d9260d7c35 service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:18.664858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1225/2465] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:17:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:17:20.381805 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.382392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.382392 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.383886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1241/2466] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:17:20.390905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9edd25-4847-4d05-8ce1-4f7daaf73666 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.391422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9edd25-4847-4d05-8ce1-4f7daaf73666 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.391591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9edd25-4847-4d05-8ce1-4f7daaf73666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.443533 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-fe9edd25-4847-4d05-8ce1-4f7daaf73666 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:20.444813 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fe9edd25-4847-4d05-8ce1-4f7daaf73666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:20.515652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1226/2467] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:17:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:20.527992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:20.529706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:20.588716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3b8b84-3ac7-4b42-a6c9-dd8749d50a85 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:20.592911 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:20.593563 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.593856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.594141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.604771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:20.606211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a2cde-68b5-44eb-951e-7204d6cd69f9 service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:20.617202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1242/2468] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:17:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:17:20.787022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3d92-8c5d-4ecc-aa73-8e1a5c419169 None None] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.787429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3d92-8c5d-4ecc-aa73-8e1a5c419169 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.787826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3d92-8c5d-4ecc-aa73-8e1a5c419169 None None] PATH_INFO: `/` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.789296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1227/2469] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:17:20.795499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225b72-d5eb-4c33-ab29-83251b3a972d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.795816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225b72-d5eb-4c33-ab29-83251b3a972d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.796101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225b72-d5eb-4c33-ab29-83251b3a972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.814341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-52225b72-d5eb-4c33-ab29-83251b3a972d None None] MFA Rules not processed for user `509c7e7fcc7c4ef19c86f1ce27232d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:20.815538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-52225b72-d5eb-4c33-ab29-83251b3a972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:20.822054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1243/2470] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:17:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:20.834193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f3d92-8c5d-4ecc-aa73-8e1a5c419169 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:20.846225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f3d92-8c5d-4ecc-aa73-8e1a5c419169 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:20.849794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:20.850440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.850749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.851042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.859009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:20.860461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308dede4-03ba-49f2-9633-ffb97e17d065 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:20.868543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1228/2471] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:17:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:17:20.953330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.955121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.955121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.955580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1244/2472] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jul 25 06:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 25 06:17:20.967505 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8120-87bb-4982-8163-53b42c4e4a18 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:20.967824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8120-87bb-4982-8163-53b42c4e4a18 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:20.968825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e8120-87bb-4982-8163-53b42c4e4a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:20.987628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-df9e8120-87bb-4982-8163-53b42c4e4a18 None None] MFA Rules not processed for user `53925cdf5a744200910943966d84ed40`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:20.989140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-df9e8120-87bb-4982-8163-53b42c4e4a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:20.998910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1229/2473] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jul 25 06:17:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:21.009635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:21.011374 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:21.025384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c6d1bf-d411-4bed-9f4b-e7407f0ddee9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:21.030088 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:21.030743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:21.031036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:21.031302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:21.042603 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:21.044784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:21.055981 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1245/2474] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:17:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:17:23.804724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:23.805177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:23.805318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:23.834044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:23.835208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:23.842905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1230/2475] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:17:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:23.860530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:23.873790 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150959d5-e9d5-46ad-95a5-8d5280d246a3 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:23.879365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:23.880058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:23.880344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:23.880623 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:23.890236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:23.891877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:23.900140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1246/2476] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:17:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:17:28.055439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:28.056969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:28.169783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:28.173010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610fdfc1-7ee1-4256-a102-a7546da244dd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:28.178683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:28.179655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:28.179932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:28.180186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:28.182214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:28.212344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:28.214231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:28.239993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1231/2477] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:17:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:17:28.241211 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:28.243329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:28.313569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96c4ab-c5ca-45a9-9e43-f24d774f0c93 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:28.319027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:28.320136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:28.320430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:28.320709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] PATH_INFO: `/v3/users/dbcaa0e9f9f04b348ed2dc5f071de4b9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:28.321915 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbcaa0e9f9f04b348ed2dc5f071de4b9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:28.324554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:28.473472 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbcaa0e9f9f04b348ed2dc5f071de4b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:28.474047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbcaa0e9f9f04b348ed2dc5f071de4b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:28.474712 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbcaa0e9f9f04b348ed2dc5f071de4b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:28.482996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbcaa0e9f9f04b348ed2dc5f071de4b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:28.495370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbcaa0e9f9f04b348ed2dc5f071de4b9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:28.561489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1247/2478] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:17:28 2022] DELETE /identity/v3/users/dbcaa0e9f9f04b348ed2dc5f071de4b9 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:17:28.815517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:28.827114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ebdc62-a1eb-413f-8c75-af848ffa8e2c service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:28.920409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:28.921433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:28.921727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:28.922007 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] PATH_INFO: `/v3/projects/31c4fa76a6f2444093744c86f01560f8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:28.923472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c4fa76a6f2444093744c86f01560f8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:28.925608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:29.084699 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c4fa76a6f2444093744c86f01560f8', 'request_id': 'req-f7158565-3f77-41e8-aeb1-55f546882622'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.091183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c4fa76a6f2444093744c86f01560f8', 'request_id': 'req-f7158565-3f77-41e8-aeb1-55f546882622'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.161958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c4fa76a6f2444093744c86f01560f8', 'request_id': 'req-f7158565-3f77-41e8-aeb1-55f546882622'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.178257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] The token cache is being invalidate because project 31c4fa76a6f2444093744c86f01560f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:17:29.178892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.179766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.182044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1232/2479] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:17:28 2022] DELETE /identity/v3/projects/31c4fa76a6f2444093744c86f01560f8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:17:29.186093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:29.187549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:29.202057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341a909-bdcc-4df2-81d6-9b8b4aa638cf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:29.205748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:29.267536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:29.268576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:29.268963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:29.269560 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] PATH_INFO: `/v3/users/73da7b1d535a4c43ac941376a8e0320a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:29.271343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73da7b1d535a4c43ac941376a8e0320a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:29.273375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:29.759082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73da7b1d535a4c43ac941376a8e0320a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.759988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73da7b1d535a4c43ac941376a8e0320a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.760693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73da7b1d535a4c43ac941376a8e0320a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.768875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73da7b1d535a4c43ac941376a8e0320a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.781476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73da7b1d535a4c43ac941376a8e0320a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:29.889586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1248/2480] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:17:29 2022] DELETE /identity/v3/users/73da7b1d535a4c43ac941376a8e0320a => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:17:30.176061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:30.177724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:30.195025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7158565-3f77-41e8-aeb1-55f546882622 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:30.264974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:30.265858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:30.266146 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:30.266429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] PATH_INFO: `/v3/projects/f694600ad0d5459fb000ca3181218826` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:30.267671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=f694600ad0d5459fb000ca3181218826)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:30.269689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:30.296717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:30.398635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f694600ad0d5459fb000ca3181218826', 'request_id': 'req-07d16e53-6433-409b-83c5-8f59a9ba98ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:30.405032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f694600ad0d5459fb000ca3181218826', 'request_id': 'req-07d16e53-6433-409b-83c5-8f59a9ba98ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:30.493258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f694600ad0d5459fb000ca3181218826', 'request_id': 'req-07d16e53-6433-409b-83c5-8f59a9ba98ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:30.506469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] The token cache is being invalidate because project f694600ad0d5459fb000ca3181218826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:17:30.506870 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:30.507439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-07d16e53-6433-409b-83c5-8f59a9ba98ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:17:30.509141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1233/2481] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:17:30 2022] DELETE /identity/v3/projects/f694600ad0d5459fb000ca3181218826 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:17:39.885091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:40.503190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=15,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:42.183910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:42.185314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:42.261953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5a249-3b82-4143-924f-07f171785725 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:42.324435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:42.325009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:42.325303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:42.325583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:42.327966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:42.340906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:42.342814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:42.354326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1249/2482] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:17:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:17:48.072668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:48.073126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:48.073259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:48.091479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:17:48.093330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:48.148967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1234/2483] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:17:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:17:48.162384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:17:48.163834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:17:48.235060 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc38acb-5e57-4cdc-82f6-73d11a927e1e service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:17:48.240940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:17:48.241599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:17:48.241886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:17:48.242162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:17:48.250774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:17:48.252380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:17:48.261266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1250/2484] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:17:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 06:17:58.141648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=25 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:17:58.257319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:38.968948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:38.970351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:39.048343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6c12b-3b77-40dc-8c9b-48ba150ef1f0 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:39.052151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:39.052802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:39.053110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:39.053371 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:39.055129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:39.119597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:39.121159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:39.131477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1235/2485] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:42.759802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:42.759802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:42.772346 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4d6ef-1d30-45b9-b769-24916667be24 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:42.776856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:42.777728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:42.777998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:42.778269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] PATH_INFO: `/v3/users/f5464624509844deaac583112045530c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:42.779440 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5464624509844deaac583112045530c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:42.781386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:42.945831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5464624509844deaac583112045530c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:42.946481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5464624509844deaac583112045530c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:42.947083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5464624509844deaac583112045530c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:42.953901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5464624509844deaac583112045530c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:42.965604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1fa44765-b8f9-4223-9324-29e2769b92c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5464624509844deaac583112045530c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.052239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1251/2486] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:18:42 2022] DELETE /identity/v3/users/f5464624509844deaac583112045530c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:43.293627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:43.304938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d7e08-4402-43a4-8466-f56328b404f5 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:43.364869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:43.365728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.366013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.366288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] PATH_INFO: `/v3/projects/372c637d60e74f9193d008d180447392` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.367448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372c637d60e74f9193d008d180447392)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:43.369391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:43.487482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:43.498914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372c637d60e74f9193d008d180447392', 'request_id': 'req-d6a02be2-bf84-44e5-8fce-679ab6d4af37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.504392 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372c637d60e74f9193d008d180447392', 'request_id': 'req-d6a02be2-bf84-44e5-8fce-679ab6d4af37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.606802 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372c637d60e74f9193d008d180447392', 'request_id': 'req-d6a02be2-bf84-44e5-8fce-679ab6d4af37'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.618422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] The token cache is being invalidate because project 372c637d60e74f9193d008d180447392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:18:43.618853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.619836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d6a02be2-bf84-44e5-8fce-679ab6d4af37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:43.621370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1236/2487] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:18:43 2022] DELETE /identity/v3/projects/372c637d60e74f9193d008d180447392 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:43.626347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.626640 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.627007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.672330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:43.673517 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:43.731967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1252/2488] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:43.739789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.740080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.740357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.758225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:43.759411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:43.767447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1237/2489] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:43.772295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:43.782369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15142933-8c45-4142-99ae-67608bee9df4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:43.787820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:43.788471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.788756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.789030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.789745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:18:43.790049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:43.791753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:43.803388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1253/2490] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:18:43.807536 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:43.816727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13b4c9-94ef-4916-9ae2-b08b3c881826 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:43.822517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:43.823171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.823460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.823777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.824475 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:43.826372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:43.911194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1238/2491] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:18:43 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:18:43.914989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:43.925255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f8b2-abbc-4dce-a3f4-a1e3fb1a8db5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:43.959297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:43.982091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:43.982801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:43.983096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:43.983373 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:43.984162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:43.986052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:44.070509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1254/2492] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:18:43 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:18:44.074743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:44.085583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40d44c-df02-4ed6-acf5-6efdc45f8e3c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:44.090268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:44.093956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:44.093956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:44.093956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:44.093956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:44.093956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:44.105388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1239/2493] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:44.109544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:44.120265 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812ddd7-b5e1-4af2-978f-1fde270e7194 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:44.125024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:44.125662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:44.128468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:44.128468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:44.128468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:44.128924 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184961-e12d-4b9c-9641-be0cd9bc90dc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:44.138670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1255/2494] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:44.143223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:44.153754 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59e41e-70e1-478f-ac12-a8a351c389ff admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:44.158879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:44.163032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:44.163032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:44.163032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] PATH_INFO: `/v3/projects/fa3a366bc2a340af82663d001e9030ab/users/dddc3804b52d4b2e8ecde8e926a0c832/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:44.175254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa3a366bc2a340af82663d001e9030ab, user_id=dddc3804b52d4b2e8ecde8e926a0c832, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:44.177905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:44.247092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1240/2495] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:18:44 2022] PUT /identity/v3/projects/fa3a366bc2a340af82663d001e9030ab/users/dddc3804b52d4b2e8ecde8e926a0c832/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:44.258090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:44.258385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:44.258671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:44.286529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] MFA Rules not processed for user `dddc3804b52d4b2e8ecde8e926a0c832`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:44.287765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:44.353127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1256/2496] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:44.364849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:44.366552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:44.439448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51279bde-1c81-4643-8514-3706a5252b91 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:44.444883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:44.445526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:44.445811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:44.446091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:44.453692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:44.455798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95ace7-c39c-42c8-b873-1bd194c4a176 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:44.464515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1241/2497] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:50.598497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:50.658903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15a3a6-1771-4c28-9099-1e7747112875 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:50.663375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:50.664273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:50.664557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:50.664833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] PATH_INFO: `/v3/users/dddc3804b52d4b2e8ecde8e926a0c832` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:50.666004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddc3804b52d4b2e8ecde8e926a0c832)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:50.667952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:50.813922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddc3804b52d4b2e8ecde8e926a0c832'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:50.815067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddc3804b52d4b2e8ecde8e926a0c832'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:50.815770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddc3804b52d4b2e8ecde8e926a0c832'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:50.817045 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:50.823549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddc3804b52d4b2e8ecde8e926a0c832'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:50.836775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddc3804b52d4b2e8ecde8e926a0c832'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:50.892536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1257/2498] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:18:50 2022] DELETE /identity/v3/users/dddc3804b52d4b2e8ecde8e926a0c832 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:50.897631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:50.898133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:50.898234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:50.916450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:50.917712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:51.079124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:51.100741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1242/2499] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:51.110510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:51.112285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:51.174105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d988-f370-4400-8c1e-dcaff7f2a022 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:51.177743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:51.182202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:51.182202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:51.182202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:51.188377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:51.189884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee1833-78b2-43e3-a72d-a766443aa839 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:51.203733 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1258/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:51.648226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:51.650337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:51.662588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd8c97-34da-44c4-816b-ce9cd88cbc0c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:51.668808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:51.672620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:51.672620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:51.672620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] PATH_INFO: `/v3/projects/fa3a366bc2a340af82663d001e9030ab` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:51.672620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa3a366bc2a340af82663d001e9030ab)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:51.673453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:51.801076 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa3a366bc2a340af82663d001e9030ab', 'request_id': 'req-cec89d55-4f71-444d-a1bc-b38509b0df0e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:51.806701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa3a366bc2a340af82663d001e9030ab', 'request_id': 'req-cec89d55-4f71-444d-a1bc-b38509b0df0e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:51.869017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa3a366bc2a340af82663d001e9030ab', 'request_id': 'req-cec89d55-4f71-444d-a1bc-b38509b0df0e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:51.882273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] The token cache is being invalidate because project fa3a366bc2a340af82663d001e9030ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:18:51.882573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:51.883211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cec89d55-4f71-444d-a1bc-b38509b0df0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:51.884761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1243/2501] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:18:51 2022] DELETE /identity/v3/projects/fa3a366bc2a340af82663d001e9030ab => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:51.890942 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:51.891410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:51.891708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:51.909269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:51.910485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:51.975941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1259/2502] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:51.983637 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:51.984107 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:51.984202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.001963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:52.003541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:52.011450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1244/2503] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:52.015849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.026350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041adab7-3013-4150-b5d0-2bbdf05aa69f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.030992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.031685 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.031975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.032257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.032990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:18:52.034003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.035782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.048491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1260/2504] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:18:52.056548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.065763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0a943-a57e-4757-8d86-380b53e0d42e None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.070657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.071312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.071632 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.071914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.072947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.074909 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.168470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1245/2505] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:18:52 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:18:52.172521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.182549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9231e-aab6-4427-8737-6fa8987b3eb1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.233767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:52.240742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.241411 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.241708 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.241980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.242700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.244642 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.401221 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1261/2506] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:18:52 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:18:52.405388 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.415410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d762a8-f8ec-4c27-adc2-7f117aa1bcdc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.419989 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.420581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.420862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.421135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.421885 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.423488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.434072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1246/2507] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:52.438129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.448960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf2c6b-9ff9-4f72-9958-c1391069040a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.453949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.454615 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.454903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.455804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.456534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.458115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a3422d-c6dd-47f7-8ee6-8de37cb3a0e6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.468736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1262/2508] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:52.472963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.482851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd308c-ad80-4574-b24c-354120dfa4c8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.488102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.488964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.490803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.490803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] PATH_INFO: `/v3/projects/9ecf3b5e23b14a2a9141ca0c44e72064/users/ebc290cf962b4dc89596cd1a71309b6f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.504610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecf3b5e23b14a2a9141ca0c44e72064, user_id=ebc290cf962b4dc89596cd1a71309b6f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.507208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.572704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1247/2509] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:18:52 2022] PUT /identity/v3/projects/9ecf3b5e23b14a2a9141ca0c44e72064/users/ebc290cf962b4dc89596cd1a71309b6f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:52.584052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.584345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.584628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.611864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] MFA Rules not processed for user `ebc290cf962b4dc89596cd1a71309b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:52.613399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:52.686245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1263/2510] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:52.697998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:52.699819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:52.758026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:52.773312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1ecc1-a8e1-435e-8d59-ee2146deaffb admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:52.778837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:52.779477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:52.779792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:52.781838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:52.788092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:52.789657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:52.798320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1248/2511] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:54.511478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:54.512909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:54.572051 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07263-0826-4719-bf1d-8e447e6d66f6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:54.575681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:54.576339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:54.576629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:54.576910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:54.578728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:54.645206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:54.646641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cdfed-24d1-441d-9e32-6a1ffa367b86 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:54.656916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1264/2512] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:55.942467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:55.952697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4897159-92a7-4548-9bbf-2333876acbc9 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:55.958308 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:55.959162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:55.959443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:55.959751 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] PATH_INFO: `/v3/users/ebc290cf962b4dc89596cd1a71309b6f` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:55.960919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc290cf962b4dc89596cd1a71309b6f)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:55.962812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:56.154662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc290cf962b4dc89596cd1a71309b6f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:56.169806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc290cf962b4dc89596cd1a71309b6f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:56.270678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc290cf962b4dc89596cd1a71309b6f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:56.279539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc290cf962b4dc89596cd1a71309b6f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:56.280789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc290cf962b4dc89596cd1a71309b6f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:56.292494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1249/2513] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:18:55 2022] DELETE /identity/v3/users/ebc290cf962b4dc89596cd1a71309b6f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:56.297445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:56.298025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:56.298025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:56.320770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:56.322222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:56.333971 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:56.414932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1265/2514] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:56.423334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:56.434701 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:56.516838 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4210-4731-4b4c-a444-b72c05cad29e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:56.521975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:56.522638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:56.522927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:56.523202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:56.535162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:56.536724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb55f10-56c0-4279-b934-7377edf56b26 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:56.547669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1250/2515] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:57.014774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.016358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:57.038043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416186-81da-46f8-ae26-56b429f69c73 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.051078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.051078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.051078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.051078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] PATH_INFO: `/v3/projects/9ecf3b5e23b14a2a9141ca0c44e72064` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.052050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecf3b5e23b14a2a9141ca0c44e72064)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.052050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.164777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecf3b5e23b14a2a9141ca0c44e72064', 'request_id': 'req-7a851450-caed-4236-be97-2eba8de0c22c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:57.172414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecf3b5e23b14a2a9141ca0c44e72064', 'request_id': 'req-7a851450-caed-4236-be97-2eba8de0c22c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:57.236568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecf3b5e23b14a2a9141ca0c44e72064', 'request_id': 'req-7a851450-caed-4236-be97-2eba8de0c22c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:57.265410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] The token cache is being invalidate because project 9ecf3b5e23b14a2a9141ca0c44e72064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:18:57.265410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:57.265410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7a851450-caed-4236-be97-2eba8de0c22c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:57.265410 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1266/2516] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:18:57 2022] DELETE /identity/v3/projects/9ecf3b5e23b14a2a9141ca0c44e72064 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:57.266367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.266821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.266918 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.288264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:57.289568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:57.358690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1251/2517] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:18:57.366721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.367253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.367365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.387481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:57.388745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:57.397948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1267/2518] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:57.402292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.407269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:57.413053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3891c5-9a12-439e-a045-bfe6b740eda3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.417857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.418603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.418957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.419302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.420234 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:18:57.420606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.422268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.436624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1252/2519] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:18:57.441529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.452491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc57d1-8e17-41aa-bd0e-2f776cc9d3b7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.459246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.459949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.460357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.460586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.461327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.463422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.556962 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1268/2520] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:18:57 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:18:57.558119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.573696 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c84-9ab5-4600-9f8f-5dba4fe90fc2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.636208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.636888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.637177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.637458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.638156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.640360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.729892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1253/2521] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:18:57 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:18:57.731167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.743089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf20f4-4095-4643-be6e-e997f3b37650 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.748913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.749622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.749891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.750338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.750901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.753119 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.766196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1269/2522] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:57.769153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.782488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b391c2-71de-41a1-81b9-425bfaaa6201 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.787211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.787941 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.788237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.788520 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.789248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.790851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7a699-9140-48ff-8843-87d16a901b40 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.804561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1254/2523] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:18:57.806552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:57.819482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822378f-d626-4ff2-a86e-fc48823ae12b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:57.825556 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:57.826463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.826753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.827036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] PATH_INFO: `/v3/projects/b8cf01316a544e1581b6298bcd4fd6b4/users/effa7caf030a4d9a832206a3d8207379/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.847063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cf01316a544e1581b6298bcd4fd6b4, user_id=effa7caf030a4d9a832206a3d8207379, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:57.849684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:57.921191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1270/2524] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:18:57 2022] PUT /identity/v3/projects/b8cf01316a544e1581b6298bcd4fd6b4/users/effa7caf030a4d9a832206a3d8207379/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:57.937358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:57.937537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:57.937866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:57.980154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] MFA Rules not processed for user `effa7caf030a4d9a832206a3d8207379`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:57.981511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:58.064357 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1255/2525] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:58.074954 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:58.076730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:58.114132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:58.152864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23bb222-c8bc-4954-bda5-196603345edf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:58.159491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:58.160126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:58.160448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:58.160693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:58.173016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:58.173016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:58.181688 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1271/2526] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:58.415367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:58.472320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:58.473853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:58.478862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:58.484327 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03608556-c3ae-4f56-958d-1c6c75de0bfa None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:58.489799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c67a-19ca-447a-980d-49666ecca00a service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:58.489938 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:58.490929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:58.491219 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:58.492061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] PATH_INFO: `/v3/users/effa7caf030a4d9a832206a3d8207379` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:58.492760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=effa7caf030a4d9a832206a3d8207379)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:58.494683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:58.496528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:58.498101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:58.498663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:58.499175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] PATH_INFO: `/v3/users/cb480fa8195647cfa6bcf3c5383b9229` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:58.501375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb480fa8195647cfa6bcf3c5383b9229)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:58.504334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:58.643712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'effa7caf030a4d9a832206a3d8207379'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.656395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'effa7caf030a4d9a832206a3d8207379'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.667044 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb480fa8195647cfa6bcf3c5383b9229'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.667723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb480fa8195647cfa6bcf3c5383b9229'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.668351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb480fa8195647cfa6bcf3c5383b9229'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.675089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb480fa8195647cfa6bcf3c5383b9229'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.686668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb480fa8195647cfa6bcf3c5383b9229'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.721661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'effa7caf030a4d9a832206a3d8207379'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.728874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'effa7caf030a4d9a832206a3d8207379'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.729507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cd49c838-5ca5-4655-97fb-714453f7e810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'effa7caf030a4d9a832206a3d8207379'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:58.735450 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1256/2527] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:18:58 2022] DELETE /identity/v3/users/effa7caf030a4d9a832206a3d8207379 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:18:58.740197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:58.740480 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:58.740752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:58.757705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:58.758889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:58.766693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1272/2528] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:18:58 2022] DELETE /identity/v3/users/cb480fa8195647cfa6bcf3c5383b9229 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:18:58.823596 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1257/2529] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:18:58.833684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:58.835157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:58.894903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956562d7-0224-4e40-9e15-39a08a73414d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:58.898543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:58.899196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:58.899486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:58.899814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:58.947912 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:58.965591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:58.967152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b721f9-ed46-43ad-acc0-5c66a090818c service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:58.977017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1273/2530] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:18:59.026764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.028561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.059682 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b888d44-49b6-4971-a2e0-e68b6f3735b1 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.075658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.076570 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.076888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.077132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] PATH_INFO: `/v3/projects/7a27d89b661143b48b22f393617cc3b1` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.078324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a27d89b661143b48b22f393617cc3b1)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.081222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.219273 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a27d89b661143b48b22f393617cc3b1', 'request_id': 'req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.224925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a27d89b661143b48b22f393617cc3b1', 'request_id': 'req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.303990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a27d89b661143b48b22f393617cc3b1', 'request_id': 'req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.312303 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:59.317237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] The token cache is being invalidate because project 7a27d89b661143b48b22f393617cc3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:18:59.317602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.318346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-90ea7f7f-ff4d-41c3-afe8-fc020b43d2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.320472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1258/2531] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:18:59 2022] DELETE /identity/v3/projects/7a27d89b661143b48b22f393617cc3b1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:59.326581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.326879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.327160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.345257 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:59.346719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.407539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1274/2532] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:59.416006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667884c-9325-42ae-a962-45f808199127 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.416562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667884c-9325-42ae-a962-45f808199127 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.416562 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667884c-9325-42ae-a962-45f808199127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.435333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8667884c-9325-42ae-a962-45f808199127 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:59.437052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8667884c-9325-42ae-a962-45f808199127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.437555 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.439062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.447858 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1259/2533] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:59.451997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667884c-9325-42ae-a962-45f808199127 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.456705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee74f3-455c-47e0-a0da-45d3b64182e9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.462282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667884c-9325-42ae-a962-45f808199127 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.462432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.463707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.463999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.464562 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] PATH_INFO: `/v3/projects/b8cf01316a544e1581b6298bcd4fd6b4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.465853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cf01316a544e1581b6298bcd4fd6b4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.467251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.467902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.468042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.468255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.468539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.469271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:18:59.469672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.471337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.487317 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1260/2534] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:18:59.488476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.498804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995d2bb-ca89-48f9-9611-d0e1b9b8c1f6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.504165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.504818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.505105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.505385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.506068 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.507982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.584566 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cf01316a544e1581b6298bcd4fd6b4', 'request_id': 'req-962e282e-4a9d-4c3e-be5e-025720aec335'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.591098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cf01316a544e1581b6298bcd4fd6b4', 'request_id': 'req-962e282e-4a9d-4c3e-be5e-025720aec335'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.598431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1261/2535] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/projects => generated 399 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:18:59.602580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.660190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cf01316a544e1581b6298bcd4fd6b4', 'request_id': 'req-962e282e-4a9d-4c3e-be5e-025720aec335'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.663901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bb656-f922-4ed0-87cf-90791e73558e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.668787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.670152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.670152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.670152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.670676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.672130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] The token cache is being invalidate because project b8cf01316a544e1581b6298bcd4fd6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:18:59.672423 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.672619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.673090 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-962e282e-4a9d-4c3e-be5e-025720aec335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:18:59.675355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1275/2536] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:18:59 2022] DELETE /identity/v3/projects/b8cf01316a544e1581b6298bcd4fd6b4 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:59.680300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b5a8-e6e6-4a27-ae97-5d2eb6d1b904 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.680691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b5a8-e6e6-4a27-ae97-5d2eb6d1b904 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.681033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c7b5a8-e6e6-4a27-ae97-5d2eb6d1b904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.698969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-46c7b5a8-e6e6-4a27-ae97-5d2eb6d1b904 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:59.700194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-46c7b5a8-e6e6-4a27-ae97-5d2eb6d1b904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.708513 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1276/2537] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:18:59.717527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.717820 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.718103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.736147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:59.738307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.747901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1262/2538] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:18:59.748878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.749548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1277/2539] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:18:59.750830 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.753779 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.762887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076c016-7ad0-440e-b710-bc9a4eddc43b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.763029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820e927-546a-4baf-b5c2-f44c3c125988 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.767872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.768162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.768521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.768679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.768796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.768978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.769078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.769233 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.769788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:18:59.769957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.770193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.771542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.771696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.781969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1263/2540] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:18:59.786372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1278/2541] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:18:59.786571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.790502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.796385 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9e369-6576-486c-88cf-83b441cc76ee admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.800837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37094523-31da-4c60-933b-9a454948b799 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.801663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.802341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.802628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.802907 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.803656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.805229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.805418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.806046 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.806332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.806610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.807281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.809186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.816035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1264/2542] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:18:59.820432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.830033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc4-bb40-4efb-b32c-6404837abbf3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:18:59.834873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:18:59.835778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.836069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.836352 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] PATH_INFO: `/v3/projects/9494c957f6b34c52a877910d3e94baeb/users/5238123efd0b47b890600d8be97cbf86/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.852048 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9494c957f6b34c52a877910d3e94baeb, user_id=5238123efd0b47b890600d8be97cbf86, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:18:59.854689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98358301-29f8-4e81-b321-68548183d058 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:18:59.911543 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1279/2543] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:18:59.915710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:18:59.933014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1265/2544] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:18:59 2022] PUT /identity/v3/projects/9494c957f6b34c52a877910d3e94baeb/users/5238123efd0b47b890600d8be97cbf86/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:18:59.935223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:18:59.943354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:18:59.943700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:18:59.944011 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:18:59.971649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] MFA Rules not processed for user `5238123efd0b47b890600d8be97cbf86`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:18:59.972959 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:18:59.981173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67ac21-d8d2-4d23-adda-eeeafb875f98 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.022541 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:00.041698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.042622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.042920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.043200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.043927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.045885 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.046516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1266/2545] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:00.051458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.062254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f649a3-6a23-4211-aa15-8f3f1aa05f83 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.067079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.067766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.068055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.068387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.073452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.073452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.127760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1280/2546] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:18:59 2022] POST /identity/v3/users => generated 303 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:00.131884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.141854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946084e-e048-4cf4-8ecd-fed4ca57b4da admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.147674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.148622 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.149237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.152313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.152313 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.153017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.157010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1267/2547] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:00.161704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.164980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1281/2548] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:00.169018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.178969 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdbf75-9b59-4b51-a33e-98a0d3bee09c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.224903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bc0a5-5198-44b6-a2a5-22cf5e451ec6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.230235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.231083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.231911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.232194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.232945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.234880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.237540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.240983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.240983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.240983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.240983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.241321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.251879 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1282/2549] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:00.256086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.266209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbf2f-466c-416a-95f6-cf97af06f383 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.271784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.272652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.272940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.273220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] PATH_INFO: `/v3/projects/9ecd783ecef44fa68fae0a08bf4ed555/users/4b63dcb59e774431bb9ef965972f9805/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.288318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ecd783ecef44fa68fae0a08bf4ed555, user_id=4b63dcb59e774431bb9ef965972f9805, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.290980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaae120-e08e-49ac-8da0-d80111dd14e5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.350928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1268/2550] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/users => generated 307 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:00.354835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.364860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05b007-f0a0-4b9c-b6e8-f9964efca958 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.369467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.370144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.370434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.370716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.371458 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.373065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.383748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1269/2551] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:00.386141 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1283/2552] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:00 2022] PUT /identity/v3/projects/9ecd783ecef44fa68fae0a08bf4ed555/users/4b63dcb59e774431bb9ef965972f9805/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:00.391521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.400510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.400802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.401079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.403169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c88054-8d67-4bca-9b7e-4831711ee023 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.425006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:00.428022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] MFA Rules not processed for user `4b63dcb59e774431bb9ef965972f9805`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:00.429389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:00.459133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.460063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.460347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.460626 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] PATH_INFO: `/v3/projects/14792531c69346e79ae6f99828cfae92/users/d55ab37b2f6745b0b8da63c1bc9ed9c5/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.476008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=14792531c69346e79ae6f99828cfae92, user_id=d55ab37b2f6745b0b8da63c1bc9ed9c5, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.478652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.495633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1284/2553] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:00.500111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.510433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385146-0594-41c3-9793-c889b0c330ec None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.515526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.516215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.520361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.520361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.520361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.520361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.543663 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1270/2554] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:00 2022] PUT /identity/v3/projects/14792531c69346e79ae6f99828cfae92/users/d55ab37b2f6745b0b8da63c1bc9ed9c5/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:00.547498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.579258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:00.607342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea05462-ec90-4d2d-ace2-6737afe255ad admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.610809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1285/2555] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/projects => generated 403 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:00.612770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.664264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.664942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.665231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.665513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.666244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.667869 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.677966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7ea41-abac-4d7a-b220-887a5325fa11 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.681318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1271/2556] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:00.682302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.683216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.683898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.684190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.684475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.685199 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.687224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.692129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb5225-a6b4-4114-a3c7-ea65c2766437 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.697165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.697634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.697921 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.698208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] PATH_INFO: `/v3/projects/14792531c69346e79ae6f99828cfae92/users/d55ab37b2f6745b0b8da63c1bc9ed9c5/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.700211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=14792531c69346e79ae6f99828cfae92, user_id=d55ab37b2f6745b0b8da63c1bc9ed9c5, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.702821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d57985-2019-4579-a52f-e06c5962fecc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.713515 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1272/2557] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:00 2022] PUT /identity/v3/projects/14792531c69346e79ae6f99828cfae92/users/d55ab37b2f6745b0b8da63c1bc9ed9c5/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:00.725110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.725453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.725745 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.751662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] MFA Rules not processed for user `d55ab37b2f6745b0b8da63c1bc9ed9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:00.753083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:00.756317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1286/2558] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/users => generated 308 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:00.760140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.771381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e4c7d-264d-4e48-8f03-84bc61d61de1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.822169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1273/2559] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:00 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:00.828633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.829312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.829601 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.829883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.831214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.832963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.833495 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.835017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:00.843219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1287/2560] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:00.847993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.857985 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358d0ea-db5f-47c0-a50d-d1316f282dba admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.863095 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.864019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.864305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.864582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] PATH_INFO: `/v3/projects/32399e8129004590840768192b4a8e9b/users/0d5a0afb178242059c8293d7e91ed9f2/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.866816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:00.879900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32399e8129004590840768192b4a8e9b, user_id=0d5a0afb178242059c8293d7e91ed9f2, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.882591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.888110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:00.914998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330e3b6-7d45-4648-95ad-caef3d833dbe None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.918629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:00.919270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:00.919607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:00.920108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:00.926871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1288/2561] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:00 2022] PUT /identity/v3/projects/32399e8129004590840768192b4a8e9b/users/0d5a0afb178242059c8293d7e91ed9f2/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:00.929218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:00.930850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:00.930987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:00.940806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1274/2562] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:00.994875 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd827b-c651-40e4-8dcb-4124efd8c9bc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:00.999687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.000362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.000650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.000930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.001656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.003295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e46c3-0bf1-4330-b35d-600ebd1b8226 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.013444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1289/2563] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:01.018581 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:01.033022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486964d9-b14f-4174-9f39-edb1239e25e5 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:01.038150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.039058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.039339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.039638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] PATH_INFO: `/v3/projects/32399e8129004590840768192b4a8e9b/users/0d5a0afb178242059c8293d7e91ed9f2/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.041635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=32399e8129004590840768192b4a8e9b, user_id=0d5a0afb178242059c8293d7e91ed9f2, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.046671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.058347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1275/2564] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:01 2022] PUT /identity/v3/projects/32399e8129004590840768192b4a8e9b/users/0d5a0afb178242059c8293d7e91ed9f2/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:01.068579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.068877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.069167 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.097035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] MFA Rules not processed for user `0d5a0afb178242059c8293d7e91ed9f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:01.098248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:01.152609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:01.168883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1290/2565] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:01.179960 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:01.181348 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:01.211983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d0c9-291c-4b79-9e3c-c69b74d63cbc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:01.215738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.216389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.216673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.216950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.240533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd1bc2-c832-4cd6-852e-55e795ed858b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:01.244343 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.244997 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.245314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.245595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.255529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.256983 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.267097 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1291/2566] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:01 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:01.274724 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.276189 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff754f2-1a2b-4c1f-9252-93794b90cd33 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.285296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1276/2567] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:01.418495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:01.427336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:01.481774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818e51e-05d8-4fca-9fa0-40a268924552 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:01.487251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.488165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.488450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.488729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] PATH_INFO: `/v3/users/4b63dcb59e774431bb9ef965972f9805` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.490016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b63dcb59e774431bb9ef965972f9805)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.492066 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.671390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b63dcb59e774431bb9ef965972f9805'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:01.672076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b63dcb59e774431bb9ef965972f9805'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:01.672656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b63dcb59e774431bb9ef965972f9805'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:01.680503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b63dcb59e774431bb9ef965972f9805'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:01.693169 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b63dcb59e774431bb9ef965972f9805'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:01.783841 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1292/2568] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:01 2022] DELETE /identity/v3/users/4b63dcb59e774431bb9ef965972f9805 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:01.788322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.789001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.789001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.806616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:01.807842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:01.868608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1277/2569] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:01.878843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:01.880285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:01.943409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b1559-5d02-4ef3-8f4e-11fe43813dc7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:01.948182 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:01.948842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:01.949146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:01.949397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:01.959122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:01.960636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:01.973332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1293/2570] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:02.414689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:02.416158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:02.428932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9198f-878b-49e2-af9b-0cb16f44f320 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:02.433493 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:02.434366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:02.434648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:02.434926 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] PATH_INFO: `/v3/projects/9ecd783ecef44fa68fae0a08bf4ed555` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:02.436149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ecd783ecef44fa68fae0a08bf4ed555)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:02.438199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:02.445025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:02.561215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ecd783ecef44fa68fae0a08bf4ed555', 'request_id': 'req-3dcfd733-e22c-44af-ad6b-ac5cecded468'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.567159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ecd783ecef44fa68fae0a08bf4ed555', 'request_id': 'req-3dcfd733-e22c-44af-ad6b-ac5cecded468'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.623923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ecd783ecef44fa68fae0a08bf4ed555', 'request_id': 'req-3dcfd733-e22c-44af-ad6b-ac5cecded468'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.636269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] The token cache is being invalidate because project 9ecd783ecef44fa68fae0a08bf4ed555 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:02.636559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.637188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.638717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1278/2571] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:02 2022] DELETE /identity/v3/projects/9ecd783ecef44fa68fae0a08bf4ed555 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:02.642978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:02.653380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20268f81-c8fa-483f-b459-6d2a88895da8 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:02.679043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:02.709987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:02.710855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:02.711142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:02.711418 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] PATH_INFO: `/v3/users/0d5a0afb178242059c8293d7e91ed9f2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:02.712641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d5a0afb178242059c8293d7e91ed9f2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:02.714565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:02.865269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d5a0afb178242059c8293d7e91ed9f2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.865964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d5a0afb178242059c8293d7e91ed9f2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.866568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d5a0afb178242059c8293d7e91ed9f2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.873646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d5a0afb178242059c8293d7e91ed9f2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.886998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0312da81-54bf-40a8-a0ab-f03b491d7243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d5a0afb178242059c8293d7e91ed9f2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:02.956831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1294/2572] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:02 2022] DELETE /identity/v3/users/0d5a0afb178242059c8293d7e91ed9f2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:03.340636 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:03.342101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:03.357725 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd733-e22c-44af-ad6b-ac5cecded468 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:03.414783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:03.415680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.415965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.416278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] PATH_INFO: `/v3/projects/32399e8129004590840768192b4a8e9b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.417442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32399e8129004590840768192b4a8e9b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:03.419344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:03.522702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32399e8129004590840768192b4a8e9b', 'request_id': 'req-1f2b26a5-cde6-462e-9826-0aae4721921d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:03.528342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32399e8129004590840768192b4a8e9b', 'request_id': 'req-1f2b26a5-cde6-462e-9826-0aae4721921d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:03.589473 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32399e8129004590840768192b4a8e9b', 'request_id': 'req-1f2b26a5-cde6-462e-9826-0aae4721921d'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:03.602194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] The token cache is being invalidate because project 32399e8129004590840768192b4a8e9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:03.602483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:03.603117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f2b26a5-cde6-462e-9826-0aae4721921d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:03.604675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1279/2573] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:03 2022] DELETE /identity/v3/projects/32399e8129004590840768192b4a8e9b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:03.609750 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.610043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.610322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.629754 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:03.630941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:03.691230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1295/2574] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:03.700197 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.700491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.700774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.719149 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:03.720414 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:03.728924 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1280/2575] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:03.733078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:03.742881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bacce7-6ba1-4949-b6f5-118d7385be26 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:03.747507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:03.748196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.748487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.748767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.749498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:03.749811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:03.751402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:03.763117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1296/2576] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:19:03.767700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:03.777669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec48112-c20c-4eb4-8c40-13bfb7e5125c None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:03.782355 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:03.782991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.783279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.783572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.784258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:03.787019 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:03.801503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:03.855037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1281/2577] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:03 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:03.859286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:03.869380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0378-52c0-4e96-8d22-aae947226f0a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:03.902174 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:03.926737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:03.927382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:03.927711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:03.927989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:03.928678 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:03.930610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.017585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1297/2578] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:03 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:04.022616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.032832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051b28-b264-4eec-b9a5-373b94416a96 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.038232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.038895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.039184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.039546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.040293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.041881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.053178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1282/2579] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:04.057190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.068089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68be55-3c44-48f0-8c07-f1006fcc4411 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.072856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.073527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.074038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.074495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.075580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.077173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112b6f1-4c6d-43b5-b3c0-4646c1f1f0be admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.087902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1298/2580] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:04.091997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.101825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b540819-2364-4186-93bf-d8cce7cb3705 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.106366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.107246 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.107528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.107842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] PATH_INFO: `/v3/projects/03bce55b0d67417c81ee13135fac5c1a/users/726365c293f2445cbbdf42c6f1bf9f70/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.121820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bce55b0d67417c81ee13135fac5c1a, user_id=726365c293f2445cbbdf42c6f1bf9f70, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.124477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.217873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1283/2581] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:04 2022] PUT /identity/v3/projects/03bce55b0d67417c81ee13135fac5c1a/users/726365c293f2445cbbdf42c6f1bf9f70/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:04.228457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.228746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.229027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.256393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] MFA Rules not processed for user `726365c293f2445cbbdf42c6f1bf9f70`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:04.257592 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:04.321599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1299/2582] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:04.325930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.386408 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e7a32-c8a5-4650-8a2b-a0c89aa5ddf8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.391340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.392026 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.392316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.392599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.393294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.395811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.470399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1284/2583] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:04 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:04.474396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.485871 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924672e8-22b4-4871-ae3e-571edc291983 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.543079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.543797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.544089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.544372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.545105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.547016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.621253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1300/2584] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:04 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:04.622321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.633764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf30dd8-bb4f-43fc-82f7-cdf6df2601b8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.638525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.639456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.639776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.640226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.640955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.642526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.654497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1285/2585] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:04.658700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.669320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c835d1-c2a5-4b38-84d9-486dffc1d611 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.673928 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.674809 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.675670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.675966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] PATH_INFO: `/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4/users/f869f46f847c4386b491bd35d1f11294/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.691431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ac779d07a44e5bb8b1d84993456fa4, user_id=f869f46f847c4386b491bd35d1f11294, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.694230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.768345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1301/2586] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:04 2022] PUT /identity/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4/users/f869f46f847c4386b491bd35d1f11294/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:04.772901 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.782810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752fe9-71ae-461e-8d68-2ac003aa06ab admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.838350 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.839012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.839306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.839627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.840436 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.842013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a895e4-b9e5-4303-ace3-cf59b020ff0a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.853694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1286/2587] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:04.857576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:04.868663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dce44-20d3-42fa-81f2-2d19e32eb350 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:04.873216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:04.874145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.874428 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.874703 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] PATH_INFO: `/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4/users/f869f46f847c4386b491bd35d1f11294/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.876705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ac779d07a44e5bb8b1d84993456fa4, user_id=f869f46f847c4386b491bd35d1f11294, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:04.879449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:04.882473 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:04.890038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1302/2588] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:04 2022] PUT /identity/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4/users/f869f46f847c4386b491bd35d1f11294/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:04.900295 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91187-7249-454f-acda-b627c58368d3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:04.900591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91187-7249-454f-acda-b627c58368d3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:04.900881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91187-7249-454f-acda-b627c58368d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:04.931240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5db91187-7249-454f-acda-b627c58368d3 None None] MFA Rules not processed for user `f869f46f847c4386b491bd35d1f11294`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:04.931240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5db91187-7249-454f-acda-b627c58368d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:04.949049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:04.999004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1287/2589] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:05.010549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:05.013375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:05.074390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9365-ad11-4111-bdbc-3a3506550720 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:05.078225 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:05.078877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:05.079172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:05.079455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:05.089217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:05.090659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdd02f1-17c7-48a4-8599-02d0748b844e service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:05.100840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1303/2590] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:05.130439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91187-7249-454f-acda-b627c58368d3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:05.193769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91187-7249-454f-acda-b627c58368d3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:05.198538 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:05.199405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:05.199727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:05.200005 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] PATH_INFO: `/v3/users/726365c293f2445cbbdf42c6f1bf9f70` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:05.201203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726365c293f2445cbbdf42c6f1bf9f70)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:05.203105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:05.362297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726365c293f2445cbbdf42c6f1bf9f70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:05.374680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726365c293f2445cbbdf42c6f1bf9f70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:05.445679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726365c293f2445cbbdf42c6f1bf9f70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:05.453106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726365c293f2445cbbdf42c6f1bf9f70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:05.453778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726365c293f2445cbbdf42c6f1bf9f70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:05.460365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1288/2591] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:05 2022] DELETE /identity/v3/users/726365c293f2445cbbdf42c6f1bf9f70 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:05.464916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:05.465215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:05.465505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:05.483758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:05.484955 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:05.543922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1304/2592] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:05.553574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:05.554977 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:05.595442 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:05.612531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb2c15-6a05-41e3-b4fe-fac9906c4359 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:05.616269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:05.616970 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:05.617254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:05.617535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:05.626560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:05.628023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:05.638391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1289/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:06.094015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:06.095497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:06.111578 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3b310-da4e-4ba3-9262-ce2347ab81c1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:06.117999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:06.118800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:06.119083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:06.119457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] PATH_INFO: `/v3/projects/03bce55b0d67417c81ee13135fac5c1a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:06.120767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bce55b0d67417c81ee13135fac5c1a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:06.122691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:06.248099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bce55b0d67417c81ee13135fac5c1a', 'request_id': 'req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.254347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bce55b0d67417c81ee13135fac5c1a', 'request_id': 'req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.294930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:06.296375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:06.309831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291da05d-27b6-4ed8-84ae-b07fce5789b0 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:06.360391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bce55b0d67417c81ee13135fac5c1a', 'request_id': 'req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.367787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:06.368739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:06.368958 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:06.369244 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] PATH_INFO: `/v3/users/5238123efd0b47b890600d8be97cbf86` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:06.370552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5238123efd0b47b890600d8be97cbf86)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:06.372605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:06.373679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] The token cache is being invalidate because project 03bce55b0d67417c81ee13135fac5c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:06.374053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.374742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.376441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1305/2594] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:06 2022] DELETE /identity/v3/projects/03bce55b0d67417c81ee13135fac5c1a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:06.380515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:06.381904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:06.395581 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe609c-b8fc-4a69-b3b9-6847bc0e44a9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:06.400327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:06.401193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:06.401479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:06.401756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] PATH_INFO: `/v3/users/f869f46f847c4386b491bd35d1f11294` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:06.402958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f869f46f847c4386b491bd35d1f11294)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:06.404938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:06.421482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:06.534311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5238123efd0b47b890600d8be97cbf86'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.546776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5238123efd0b47b890600d8be97cbf86'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.608571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f869f46f847c4386b491bd35d1f11294'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.609222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f869f46f847c4386b491bd35d1f11294'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.609825 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f869f46f847c4386b491bd35d1f11294'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.617752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f869f46f847c4386b491bd35d1f11294'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.617880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5238123efd0b47b890600d8be97cbf86'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.625055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5238123efd0b47b890600d8be97cbf86'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.625685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-13e16871-9d91-40b1-a6c2-f182fd58ea28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5238123efd0b47b890600d8be97cbf86'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.630850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f869f46f847c4386b491bd35d1f11294'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:06.631788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1290/2595] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:06 2022] DELETE /identity/v3/users/5238123efd0b47b890600d8be97cbf86 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:06.636148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:06.636444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:06.636730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:06.654437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:06.655692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:06.686500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1306/2596] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:06 2022] DELETE /identity/v3/users/f869f46f847c4386b491bd35d1f11294 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:06.711217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:06.720532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1291/2597] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:06.731210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:06.732786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:06.794137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af076511-14df-443c-b6ba-ed6601afed80 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:06.797999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:06.798675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:06.798965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:06.799248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:06.867056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:06.868648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:06.879741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1307/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:07.364614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:07.366144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:07.387022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:07.389397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb95177-670d-4085-9d3a-944b18336f19 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:07.389657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:07.397190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:07.398003 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.398818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.399177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] PATH_INFO: `/v3/projects/9494c957f6b34c52a877910d3e94baeb` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.400781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9494c957f6b34c52a877910d3e94baeb)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:07.402760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4d7bc-2c5e-4f3e-94b0-8c1b198b8507 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:07.402947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:07.409487 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:07.410375 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.410661 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.410940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] PATH_INFO: `/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.412352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ac779d07a44e5bb8b1d84993456fa4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:07.414264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:07.589251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:07.596901 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ac779d07a44e5bb8b1d84993456fa4', 'request_id': 'req-7bfcb31b-233c-4bfa-832e-dfdd3300744c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.602984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ac779d07a44e5bb8b1d84993456fa4', 'request_id': 'req-7bfcb31b-233c-4bfa-832e-dfdd3300744c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.613211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9494c957f6b34c52a877910d3e94baeb', 'request_id': 'req-9d120e5e-16b6-4bfd-a3be-b10efa004fee'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.618622 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9494c957f6b34c52a877910d3e94baeb', 'request_id': 'req-9d120e5e-16b6-4bfd-a3be-b10efa004fee'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.692709 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ac779d07a44e5bb8b1d84993456fa4', 'request_id': 'req-7bfcb31b-233c-4bfa-832e-dfdd3300744c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.703925 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] The token cache is being invalidate because project f8ac779d07a44e5bb8b1d84993456fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:07.706033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.706033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7bfcb31b-233c-4bfa-832e-dfdd3300744c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.706382 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1308/2599] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:07 2022] DELETE /identity/v3/projects/f8ac779d07a44e5bb8b1d84993456fa4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:07.711114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f784-cce7-48fb-94e5-814098514e75 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.711406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f784-cce7-48fb-94e5-814098514e75 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.711725 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6f784-cce7-48fb-94e5-814098514e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.729431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c8b6f784-cce7-48fb-94e5-814098514e75 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:07.730652 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c8b6f784-cce7-48fb-94e5-814098514e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:07.748920 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9494c957f6b34c52a877910d3e94baeb', 'request_id': 'req-9d120e5e-16b6-4bfd-a3be-b10efa004fee'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.761831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] The token cache is being invalidate because project 9494c957f6b34c52a877910d3e94baeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:07.763886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.763886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:07.764702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1292/2600] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:07 2022] DELETE /identity/v3/projects/9494c957f6b34c52a877910d3e94baeb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:07.768516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:07.770134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:07.792852 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1309/2601] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:07.801537 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.801836 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.802122 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.820445 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:07.821649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:07.829784 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1310/2602] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:07.833859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:07.835606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d120e5e-16b6-4bfd-a3be-b10efa004fee admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:07.840200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:07.841064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.841344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.841617 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] PATH_INFO: `/v3/users/d55ab37b2f6745b0b8da63c1bc9ed9c5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.842834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55ab37b2f6745b0b8da63c1bc9ed9c5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:07.843083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a8672-3d66-42bc-8cdb-d9832d07e8eb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:07.844764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:07.848307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:07.848979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.849267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.849548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.850270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:07.850582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:07.852360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:07.867932 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1311/2603] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:07.868949 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:07.878546 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d696a14-934c-4066-86f5-2084e14467f0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:07.884024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:07.884024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:07.884024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:07.884496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:07.885049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:07.886906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:07.980334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1312/2604] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:07 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:07.984273 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.047875 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55ab37b2f6745b0b8da63c1bc9ed9c5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.052856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85620c-305c-486e-b1eb-7b7dd11192cc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.057695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.058449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.058736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.059009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.059742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.060429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55ab37b2f6745b0b8da63c1bc9ed9c5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.061620 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.103965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55ab37b2f6745b0b8da63c1bc9ed9c5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.111096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55ab37b2f6745b0b8da63c1bc9ed9c5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.114485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55ab37b2f6745b0b8da63c1bc9ed9c5'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.115058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:08.119304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1293/2605] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:07 2022] DELETE /identity/v3/users/d55ab37b2f6745b0b8da63c1bc9ed9c5 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:08.135842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1313/2606] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:07 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:08.137046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.138500 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.205638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ae86-5b72-44bd-ae97-b675488d3061 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.211212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.212174 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.212482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.212763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.213494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.215100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.225982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1294/2607] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:08.233795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.240413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887f71c-b890-4e61-95b0-e466a9e7df79 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.245043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.245693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.245976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.246250 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.246968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.248571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcdf46-d814-462f-ab39-18e3f8cca208 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.258645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1314/2608] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:08.262824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.274532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de905f83-0353-46a3-a63d-7de9596b51a8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.279141 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.280150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.280434 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.280710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] PATH_INFO: `/v3/projects/0cdf891503f44114ab41fca3f061080b/users/7d14bf60a4f94b8b9974c338a9572a51/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.296315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdf891503f44114ab41fca3f061080b, user_id=7d14bf60a4f94b8b9974c338a9572a51, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.299195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.384889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1295/2609] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:08 2022] PUT /identity/v3/projects/0cdf891503f44114ab41fca3f061080b/users/7d14bf60a4f94b8b9974c338a9572a51/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:08.396609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.397117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.397236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.404031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:08.426381 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] MFA Rules not processed for user `7d14bf60a4f94b8b9974c338a9572a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:08.427656 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.492022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1315/2610] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:08.502646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.504872 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.529072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.531041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.575771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754f7d3-92f6-400d-be0f-214de0270a1c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.579474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.580190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.580476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.580756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.591364 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.595509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863833c-0bb9-49ba-b38d-a880e56296f3 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.602467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1296/2611] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:08.615393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb046bbc-8ec9-4281-ac5c-07e13d29b7e8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.620168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.625326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.625326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.625326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] PATH_INFO: `/v3/projects/14792531c69346e79ae6f99828cfae92` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.625326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14792531c69346e79ae6f99828cfae92)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.625326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.715608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14792531c69346e79ae6f99828cfae92', 'request_id': 'req-f3780eac-9340-4bcb-858d-6933279f39a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.721351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14792531c69346e79ae6f99828cfae92', 'request_id': 'req-f3780eac-9340-4bcb-858d-6933279f39a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.772018 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14792531c69346e79ae6f99828cfae92', 'request_id': 'req-f3780eac-9340-4bcb-858d-6933279f39a9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.783322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] The token cache is being invalidate because project 14792531c69346e79ae6f99828cfae92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:08.783633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.784274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f3780eac-9340-4bcb-858d-6933279f39a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:08.786267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1316/2612] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:08 2022] DELETE /identity/v3/projects/14792531c69346e79ae6f99828cfae92 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:08.791208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9402-525f-47c2-9e26-d63a053186be None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.791763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9402-525f-47c2-9e26-d63a053186be None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.791940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9402-525f-47c2-9e26-d63a053186be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.810347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-aede9402-525f-47c2-9e26-d63a053186be None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:08.811616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-aede9402-525f-47c2-9e26-d63a053186be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.871300 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1297/2613] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:08.879778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.880067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.880341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.899600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:08.900802 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:08.908758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1317/2614] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:08.913423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9402-525f-47c2-9e26-d63a053186be None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.923148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9402-525f-47c2-9e26-d63a053186be None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.928825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.929483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.929770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.930049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.930774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:08.931145 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.932781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.947429 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1298/2615] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:08.951726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:08.961151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8d162-980e-4d3b-8173-ed03cce169ca None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:08.965857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:08.966534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:08.966830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:08.967100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:08.967826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:08.969721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:08.983979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:09.056524 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1318/2616] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:08 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:09.059550 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.064737 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:09.071405 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc344a1-14aa-4160-a6d7-c255d07efd3f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.127643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.129368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.129368 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.129631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.130312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.132289 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.241979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1299/2617] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:09 2022] POST /identity/v3/users => generated 305 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:09.246112 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.257527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21724044-e650-4bf2-8e2a-c54ab7f5b59c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.262822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.263510 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.263822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.264361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.265117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.266700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.277746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1319/2618] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:09.281702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.292972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073541d-7dfc-46fb-9dcf-f8c660570188 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.297721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.298324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.298606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.298878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.299631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.301211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf93f46-cf09-496a-8aca-4574199ddc7a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.312868 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1300/2619] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:09.316340 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.326630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3075b-b911-48ee-b105-f4e20bb747a0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.331251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.338486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.338486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.338486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] PATH_INFO: `/v3/projects/9d13f1dd04cc4225ba0c82645a3fa034/users/9629d5562dd342f8a4b29eab8404d95c/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.347796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d13f1dd04cc4225ba0c82645a3fa034, user_id=9629d5562dd342f8a4b29eab8404d95c, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.351152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.441748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1320/2620] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:09 2022] PUT /identity/v3/projects/9d13f1dd04cc4225ba0c82645a3fa034/users/9629d5562dd342f8a4b29eab8404d95c/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:09.453163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.453462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.453794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.480978 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] MFA Rules not processed for user `9629d5562dd342f8a4b29eab8404d95c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:09.482210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:09.547258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1301/2621] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:09.552457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.613717 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835176b-8750-4e7e-8283-ddb26f94b141 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.619054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.619756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.620043 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.620326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.621027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.623086 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.739016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1321/2622] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:09 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:09.743195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.753949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086e5c-9f2d-4a97-b0ad-0996e75cb8f3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.810012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.810640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.810882 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.811163 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.811877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.813777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.876046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:09.881154 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1302/2623] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:09 2022] POST /identity/v3/users => generated 309 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:09.885394 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.896380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b25ab4-58b0-4281-b8f6-d460669dd985 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.901098 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.901760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.902334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.902334 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.903053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.904653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:09.915966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1322/2624] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:09.920883 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:09.931280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf00f83-9c70-4e5d-9309-94cbc8de3243 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:09.936826 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:09.937435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:09.937716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:09.937990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] PATH_INFO: `/v3/projects/23d4285a0522425b9c336a7748d585cc/users/e0432e62907f40ce907283233fe867e8/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:09.953672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d4285a0522425b9c336a7748d585cc, user_id=e0432e62907f40ce907283233fe867e8, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:09.956328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:10.012213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1303/2625] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:09 2022] PUT /identity/v3/projects/23d4285a0522425b9c336a7748d585cc/users/e0432e62907f40ce907283233fe867e8/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:10.016449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:10.027177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67baebd-3242-44d2-b24a-07e2d1dceac0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:10.084945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:10.085548 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.085838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.086117 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.086855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:10.088520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4334d77-9fef-4840-a94f-eb8d555f40ba admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:10.099269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1323/2626] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:10.103842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:10.115425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0502e-42e7-4b5e-b127-228d933c60a3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:10.120232 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:10.121109 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.121411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.121668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] PATH_INFO: `/v3/projects/23d4285a0522425b9c336a7748d585cc/users/e0432e62907f40ce907283233fe867e8/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.123681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d4285a0522425b9c336a7748d585cc, user_id=e0432e62907f40ce907283233fe867e8, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:10.126328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:10.137282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1304/2627] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:10 2022] PUT /identity/v3/projects/23d4285a0522425b9c336a7748d585cc/users/e0432e62907f40ce907283233fe867e8/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:10.147968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95114d-70b1-474d-aa9c-5879924f9101 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.148269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95114d-70b1-474d-aa9c-5879924f9101 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.148557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95114d-70b1-474d-aa9c-5879924f9101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.175105 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-bf95114d-70b1-474d-aa9c-5879924f9101 None None] MFA Rules not processed for user `e0432e62907f40ce907283233fe867e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:10.177456 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bf95114d-70b1-474d-aa9c-5879924f9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:10.195491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:10.247267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1324/2628] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:10 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:10.258329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:10.268030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:10.284783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.285108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.286173 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.306254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] MFA Rules not processed for user `7d14bf60a4f94b8b9974c338a9572a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:10.307484 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:10.318610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cf1fd-61fc-40de-969e-a2b385275fa1 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:10.322281 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:10.322925 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.323208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.323483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.332666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:10.334213 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:10.343798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1305/2629] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:10.365993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1325/2630] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:10.668525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:10.681097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710b3bf-a481-4bb6-9e28-91cf4690deae service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:10.685150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:10.685841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:10.686150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:10.686430 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:10.745139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:10.746560 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57306410-3e3d-44ad-ae9a-fcb3c48a4719 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:10.756084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1306/2631] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:17.399331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:17.462798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a8ff5-684f-4941-886b-3a1137b0c9e9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:17.467310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:17.468248 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:17.468533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:17.468814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] PATH_INFO: `/v3/users/9629d5562dd342f8a4b29eab8404d95c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:17.470004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9629d5562dd342f8a4b29eab8404d95c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:17.471964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:17.654106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9629d5562dd342f8a4b29eab8404d95c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:17.654683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9629d5562dd342f8a4b29eab8404d95c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:17.655294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9629d5562dd342f8a4b29eab8404d95c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:17.662671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9629d5562dd342f8a4b29eab8404d95c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:17.667793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:17.674420 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9629d5562dd342f8a4b29eab8404d95c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:17.744377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1326/2632] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:17 2022] DELETE /identity/v3/users/9629d5562dd342f8a4b29eab8404d95c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:17.748956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:17.749627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:17.749627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:17.768081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:17.769282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:17.827479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1307/2633] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:17.837723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:17.839269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:17.900081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41bdeb6-d3b7-4b94-847c-b70de7b2818f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:17.905504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:17.906140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:17.906430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:17.906711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:17.917849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:17.919341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:17.930031 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1327/2634] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:18.454286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:18.455962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:18.465022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:18.469260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f947c8a-7e7b-4f5d-a28c-887f066cc55b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:18.474073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:18.475962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:18.475962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:18.475962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] PATH_INFO: `/v3/projects/9d13f1dd04cc4225ba0c82645a3fa034` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:18.476841 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d13f1dd04cc4225ba0c82645a3fa034)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:18.478740 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:18.585256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d13f1dd04cc4225ba0c82645a3fa034', 'request_id': 'req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.590703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d13f1dd04cc4225ba0c82645a3fa034', 'request_id': 'req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.669445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d13f1dd04cc4225ba0c82645a3fa034', 'request_id': 'req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.682133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] The token cache is being invalidate because project 9d13f1dd04cc4225ba0c82645a3fa034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:18.682421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.683062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.684674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1308/2635] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:18 2022] DELETE /identity/v3/projects/9d13f1dd04cc4225ba0c82645a3fa034 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:18.688706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:18.699136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ce42e-a7d6-4bcc-9819-925d1064d079 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:18.762822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:18.763732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:18.764291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:18.764561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] PATH_INFO: `/v3/users/e0432e62907f40ce907283233fe867e8` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:18.765874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0432e62907f40ce907283233fe867e8)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:18.767916 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:18.911995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0432e62907f40ce907283233fe867e8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.912990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0432e62907f40ce907283233fe867e8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.913647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0432e62907f40ce907283233fe867e8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.921177 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0432e62907f40ce907283233fe867e8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:18.934467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0ebfc53-d420-4f3f-8ed8-6672ba4a738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0432e62907f40ce907283233fe867e8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.007574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1328/2636] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:18 2022] DELETE /identity/v3/users/e0432e62907f40ce907283233fe867e8 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:19.622193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:19.624025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:19.639616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9bb1-1201-4c66-9b4e-01b8b5b80ac0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:19.717275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:19.719027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:19.719027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:19.719027 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] PATH_INFO: `/v3/projects/23d4285a0522425b9c336a7748d585cc` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:19.720166 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d4285a0522425b9c336a7748d585cc)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:19.722084 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:19.835967 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d4285a0522425b9c336a7748d585cc', 'request_id': 'req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.843255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d4285a0522425b9c336a7748d585cc', 'request_id': 'req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.915443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d4285a0522425b9c336a7748d585cc', 'request_id': 'req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.929362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] The token cache is being invalidate because project 23d4285a0522425b9c336a7748d585cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:19.929655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.930395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-51d6edfe-d4ca-4a94-ba64-7bbaeed7397a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:19.932358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1309/2637] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:19 2022] DELETE /identity/v3/projects/23d4285a0522425b9c336a7748d585cc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:19.937188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:19.943159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:19.943159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:19.950576 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:19.967363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:19.967363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:20.027944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1329/2638] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:20.036188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.036688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.037080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.064296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:20.065623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:20.076871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1310/2639] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:20.082897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.094184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426bbe5-aa94-417f-8590-c27febf6e6e1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.102951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.103951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.104297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.104400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.105075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:20.105388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.107100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.123978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1330/2640] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:20.128042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.138210 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a98ca-6466-4311-90bb-de3d831cb147 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.143526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.144242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.144513 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.144795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.146225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.148178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.157177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:20.240919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1311/2641] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:20.241884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.252663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691f2b5-7859-4ce5-8073-a455b12a2d95 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.322646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.323330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.323647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.323930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.324624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.326530 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.447073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1331/2642] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:20.451698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.463481 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ee11-3468-4e4d-9458-d979eab4e8ef admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.468086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.468793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.469142 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.469424 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.470147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.471763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.483427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1312/2643] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:20.487345 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.498062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853b7d4-efac-4d55-84f2-a1907d5d2d43 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.502900 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.503547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.503861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.504140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.504856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.507697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936d7a3-7e68-4391-8eb2-789a03c2a7bb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.518276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1332/2644] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:20.523055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.533426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9a2c3-cc45-4062-9839-918e0ea1d73b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.538762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.539721 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.540006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.540282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] PATH_INFO: `/v3/projects/d57fac4b0d8d4ca4835277ad390a7c49/users/a355217ae72f4f198e2d0f24f0fcb48f/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.555492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57fac4b0d8d4ca4835277ad390a7c49, user_id=a355217ae72f4f198e2d0f24f0fcb48f, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.558345 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.612597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1313/2645] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:20 2022] PUT /identity/v3/projects/d57fac4b0d8d4ca4835277ad390a7c49/users/a355217ae72f4f198e2d0f24f0fcb48f/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:20.624775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.625073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.625358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.653833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] MFA Rules not processed for user `a355217ae72f4f198e2d0f24f0fcb48f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:20.655054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:20.719710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:20.725583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1333/2646] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:20.736092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.810815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85385e0d-78e7-4063-b025-96cca6e58ef5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.815764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.816433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.816722 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.817004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.817730 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.820313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:20.899494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1314/2647] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:20.903464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:20.914262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93fff7c-06f3-48e1-bdc1-cc770c655e4c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:20.969998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:20.970629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:20.970869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:20.971147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:20.971882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:20.973795 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.049073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1334/2648] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:20 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:21.053776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.064008 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d60a62-ae4d-4258-a68a-233e67c77e78 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.069850 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.070519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.070808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.071091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.071845 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.073439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.084266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1315/2649] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:21.088301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.098210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fbc2-80a7-4822-9746-6e75d79fd7ab admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.103063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.103974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.104260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.104536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] PATH_INFO: `/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6/users/8e543303b6c144c7987d3bad3e233ae3/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.119586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1c161a8fc9420c8a22fa80fc3b54d6, user_id=8e543303b6c144c7987d3bad3e233ae3, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.122215 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.183937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1335/2650] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:21 2022] PUT /identity/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6/users/8e543303b6c144c7987d3bad3e233ae3/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:21.188035 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.198766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49091c4f-2c20-4761-8c7e-ff13a6de2ad0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.253039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.253702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.253984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.254259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.254968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.257297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe4577-5378-454b-8e5c-2941dc57f904 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.267223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1316/2651] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:21.271455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.281961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013984-f00a-4ccc-ad2c-5dd5783e9123 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.286648 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.288171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.288489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.288770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] PATH_INFO: `/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6/users/8e543303b6c144c7987d3bad3e233ae3/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.290785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1c161a8fc9420c8a22fa80fc3b54d6, user_id=8e543303b6c144c7987d3bad3e233ae3, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.293442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.304292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1336/2652] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:21 2022] PUT /identity/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6/users/8e543303b6c144c7987d3bad3e233ae3/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:21.314457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.314746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.315025 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.341815 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] MFA Rules not processed for user `8e543303b6c144c7987d3bad3e233ae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:21.343105 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:21.355467 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:21.411739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1317/2653] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:21.423631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.425337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:21.482766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29bf39-0c28-458c-8804-98afd746fc2c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.486490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.487133 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.487444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.487758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.497629 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.499049 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.508808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1337/2654] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:21.716586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:21.727006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe4413-a4d2-47e1-a239-e474e0f7b929 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:21.730691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:21.731334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:21.731655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:21.731937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:21.789055 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:21.790441 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fe1a6-323e-4ed7-8f66-d1aadc06604b service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:21.799162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1318/2655] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:27.947575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:28.000329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:28.011742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ed4ec-fbf9-466c-bd8b-f7647bd058fb service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:28.016655 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:28.017529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:28.017821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:28.018100 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] PATH_INFO: `/v3/users/a355217ae72f4f198e2d0f24f0fcb48f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:28.019290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a355217ae72f4f198e2d0f24f0fcb48f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:28.021241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:28.139990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a355217ae72f4f198e2d0f24f0fcb48f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.140677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a355217ae72f4f198e2d0f24f0fcb48f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.141312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a355217ae72f4f198e2d0f24f0fcb48f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.148228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a355217ae72f4f198e2d0f24f0fcb48f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.160506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a355217ae72f4f198e2d0f24f0fcb48f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.246796 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1338/2656] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:27 2022] DELETE /identity/v3/users/a355217ae72f4f198e2d0f24f0fcb48f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:28.251409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:28.251879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:28.252001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:28.269812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:28.270996 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:28.401059 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1319/2657] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:28.410720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:28.412186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:28.470568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2efeeb-6760-4e08-83d8-b1696eca5047 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:28.474201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:28.474853 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:28.475143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:28.475422 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:28.485210 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:28.486682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:28.496292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1339/2658] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:28.865106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:28.866593 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:28.881012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbad720-cca5-4c8d-80ba-4e16c9335a98 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:28.886474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:28.888110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:28.888531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:28.888702 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] PATH_INFO: `/v3/projects/d57fac4b0d8d4ca4835277ad390a7c49` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:28.890119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57fac4b0d8d4ca4835277ad390a7c49)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:28.892065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:28.976081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:28.980151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57fac4b0d8d4ca4835277ad390a7c49', 'request_id': 'req-15607694-b642-49b8-9fd8-936386e82dad'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:28.986410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57fac4b0d8d4ca4835277ad390a7c49', 'request_id': 'req-15607694-b642-49b8-9fd8-936386e82dad'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.063572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57fac4b0d8d4ca4835277ad390a7c49', 'request_id': 'req-15607694-b642-49b8-9fd8-936386e82dad'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.075962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] The token cache is being invalidate because project d57fac4b0d8d4ca4835277ad390a7c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:29.076255 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.077017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.078606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1320/2659] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:28 2022] DELETE /identity/v3/projects/d57fac4b0d8d4ca4835277ad390a7c49 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:29.082470 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:29.092591 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650499cf-87a3-4ba7-8fb2-317253d884e5 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:29.151681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:29.152568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:29.152855 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:29.153189 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] PATH_INFO: `/v3/users/8e543303b6c144c7987d3bad3e233ae3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:29.154398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e543303b6c144c7987d3bad3e233ae3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:29.156353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:29.178159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:29.339523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e543303b6c144c7987d3bad3e233ae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.340170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e543303b6c144c7987d3bad3e233ae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.340835 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e543303b6c144c7987d3bad3e233ae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.347987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e543303b6c144c7987d3bad3e233ae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.360047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4e345b13-d74b-4568-a183-5bdf6f33652d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e543303b6c144c7987d3bad3e233ae3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:29.474938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1340/2660] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:29 2022] DELETE /identity/v3/users/8e543303b6c144c7987d3bad3e233ae3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:29.916994 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:29.918504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:29.933866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15607694-b642-49b8-9fd8-936386e82dad admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:29.991470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:29.992356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:29.992638 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:29.992911 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] PATH_INFO: `/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:29.994586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1c161a8fc9420c8a22fa80fc3b54d6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:29.996521 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.126428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1c161a8fc9420c8a22fa80fc3b54d6', 'request_id': 'req-a4e8e92d-b842-4c77-aeb9-113249e333ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:30.131731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1c161a8fc9420c8a22fa80fc3b54d6', 'request_id': 'req-a4e8e92d-b842-4c77-aeb9-113249e333ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:30.194465 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1c161a8fc9420c8a22fa80fc3b54d6', 'request_id': 'req-a4e8e92d-b842-4c77-aeb9-113249e333ab'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:30.206358 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] The token cache is being invalidate because project da1c161a8fc9420c8a22fa80fc3b54d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:30.206646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:30.207271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a4e8e92d-b842-4c77-aeb9-113249e333ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:30.208811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1321/2661] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:29 2022] DELETE /identity/v3/projects/da1c161a8fc9420c8a22fa80fc3b54d6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:30.214202 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.214663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.214774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.232752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:30.233952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:30.293271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1341/2662] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:30.301966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.302257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.302540 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.320656 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:30.322366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:30.330245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1322/2663] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:30.334336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.344746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d616d-1014-4c04-a0ea-4d071bf0efd9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.349380 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.350023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.350308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.350586 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.351305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:30.351645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.353230 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.364810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1342/2664] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:30.369168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.378258 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd737e4-a0da-4e2c-9dad-07b57e816a64 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.382913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.383575 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.384411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.384690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.385380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.387260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.482307 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1323/2665] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:30 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:30.486515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.496482 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a243d2-073b-426f-a04c-870c3d957b25 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.552514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.553180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.553467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.553745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.554438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.557030 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.624175 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1343/2666] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:30 2022] POST /identity/v3/users => generated 294 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:30.628340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.639770 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e694f-a86d-4d36-a922-178eab3b78f6 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.644328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.645058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.645337 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.645613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.646338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.647969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.658143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1324/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:30.672296 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.685643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcda30-1dd7-4c35-9cdc-eb2555c0c825 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.690311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87287437-1402-4470-8908-5ba541490851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.691462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287437-1402-4470-8908-5ba541490851 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.691462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287437-1402-4470-8908-5ba541490851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.691680 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87287437-1402-4470-8908-5ba541490851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.692395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287437-1402-4470-8908-5ba541490851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.693980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87287437-1402-4470-8908-5ba541490851 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.700062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:30.707071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1344/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:30.711631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:30.722322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f14db4-d4d1-4037-b30c-b10deafb453b admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:30.727148 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:30.728090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.728344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.728619 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] PATH_INFO: `/v3/projects/50d3835dee9843dc9e7bf3bb1f383eea/users/2ee152acfc414468b144b5e70eee271a/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.743704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:30.745202 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d3835dee9843dc9e7bf3bb1f383eea, user_id=2ee152acfc414468b144b5e70eee271a, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:30.747897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:30.825599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1325/2669] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:30 2022] PUT /identity/v3/projects/50d3835dee9843dc9e7bf3bb1f383eea/users/2ee152acfc414468b144b5e70eee271a/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:30.837272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:30.837572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:30.837884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:30.986943 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] MFA Rules not processed for user `2ee152acfc414468b144b5e70eee271a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:30.988212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:31.054829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1345/2670] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:31.060415 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.126957 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff094f0-09b9-4ba4-9c29-5bce0b6c30fc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.131715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.132370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.132651 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.132923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.133599 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.135565 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.218668 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1326/2671] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:31 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:31.222734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.234239 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c04df5-d581-4214-9673-ec7b80e80e02 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.291702 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.292376 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.292664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.292948 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.293663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.295665 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.407520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1346/2672] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:31 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:31.411413 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.423193 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996adb98-6a1a-43f0-8f24-51b2bd09640e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.427794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.428452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.428738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.429013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.429733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.431333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.443039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1327/2673] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:31.448039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.458461 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610de2-e0cc-43b3-9af0-5f5dae11435e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.463888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.464773 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.465053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.465322 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] PATH_INFO: `/v3/projects/bf381a8497704cecb1998d5bed731f97/users/c664bd26a9604401955c4fe1cd4fd367/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.482002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf381a8497704cecb1998d5bed731f97, user_id=c664bd26a9604401955c4fe1cd4fd367, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.484755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.573140 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1347/2674] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:31 2022] PUT /identity/v3/projects/bf381a8497704cecb1998d5bed731f97/users/c664bd26a9604401955c4fe1cd4fd367/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:31.577389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.588262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99672a-ca73-46b6-9e58-49ab7e80e460 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.648447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.649127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.649999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.650286 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.651085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.652776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8174ac-45a3-4def-ba00-8d5cf15df77f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.664130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1328/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:31.669052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.679476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac39d-0bd4-4768-8ee1-96e6d97346f8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.684271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.687938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.687938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.687938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] PATH_INFO: `/v3/projects/bf381a8497704cecb1998d5bed731f97/users/c664bd26a9604401955c4fe1cd4fd367/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.687938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf381a8497704cecb1998d5bed731f97, user_id=c664bd26a9604401955c4fe1cd4fd367, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.690450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.701442 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1348/2676] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:31 2022] PUT /identity/v3/projects/bf381a8497704cecb1998d5bed731f97/users/c664bd26a9604401955c4fe1cd4fd367/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:31.711800 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.712878 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.713279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.739494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] MFA Rules not processed for user `c664bd26a9604401955c4fe1cd4fd367`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:31.740742 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:31.813435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:31.839690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1329/2677] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:31.856414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:31.858481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:31.922007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:31.937781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315c6a9-c90e-48ac-a333-63df52e22988 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:31.942196 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:31.943191 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:31.943486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:31.943945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:31.956295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:31.957735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0cba0e-76aa-424f-a8cd-6702b64f0c10 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:31.970550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1349/2678] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:33.119190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:33.185203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610129f-f9c8-46c3-9a3a-8d1a0721fe05 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:33.189904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:33.190783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.191069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.191346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] PATH_INFO: `/v3/users/2ee152acfc414468b144b5e70eee271a` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.192790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee152acfc414468b144b5e70eee271a)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:33.194718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:33.286157 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864601d-4389-43a1-973f-74cbc41a228b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.286609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864601d-4389-43a1-973f-74cbc41a228b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.286724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864601d-4389-43a1-973f-74cbc41a228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.304571 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a864601d-4389-43a1-973f-74cbc41a228b None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:33.305840 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a864601d-4389-43a1-973f-74cbc41a228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.360874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1350/2679] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:19:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:33.393485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee152acfc414468b144b5e70eee271a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:33.406532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee152acfc414468b144b5e70eee271a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:33.452040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee152acfc414468b144b5e70eee271a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:33.459203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee152acfc414468b144b5e70eee271a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:33.460483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee152acfc414468b144b5e70eee271a'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:33.467406 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1330/2680] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:33 2022] DELETE /identity/v3/users/2ee152acfc414468b144b5e70eee271a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:33.471918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.472262 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.472544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.474590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:33.475986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.490509 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:33.491711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.546156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981bc86-2d47-48c5-b2b5-b70516e13cab admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:33.550355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1351/2681] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:33.551250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:33.551927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.552218 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.552499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.555074 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.560465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:33.560900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:33.562021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.626647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fed1ab-208b-4106-8311-3d07e3cbbf91 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:33.628162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:33.630096 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:33.630538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:33.631341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.631664 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.631944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.639760 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1331/2682] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:19:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:19:33.640561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:33.641999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.643430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:33.649569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:33.655398 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1352/2683] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:33.703794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1dd0b-cc3d-44af-9f39-e1cb796ff97a service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:33.707447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:33.708124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:33.708416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:33.708703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:33.710587 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:33.786965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:33.788542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:33.800694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1332/2684] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:34.085552 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:34.086951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:34.104536 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0844a78-0871-42dc-a4f6-05df0a0fa0b0 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:34.111643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:34.112736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:34.113134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:34.113479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] PATH_INFO: `/v3/projects/50d3835dee9843dc9e7bf3bb1f383eea` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:34.115092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d3835dee9843dc9e7bf3bb1f383eea)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:34.117804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:34.237742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:34.254807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d3835dee9843dc9e7bf3bb1f383eea', 'request_id': 'req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.261282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d3835dee9843dc9e7bf3bb1f383eea', 'request_id': 'req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.331815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d3835dee9843dc9e7bf3bb1f383eea', 'request_id': 'req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.344180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] The token cache is being invalidate because project 50d3835dee9843dc9e7bf3bb1f383eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:34.344466 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.345101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fdc29068-d6fe-4cf2-b51d-27edac4f8d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.346634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1353/2685] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:34 2022] DELETE /identity/v3/projects/50d3835dee9843dc9e7bf3bb1f383eea => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:34.350990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:34.362265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9ede7-be97-4458-8809-bf3f2c3a6ba0 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:34.406101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=100 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:34.419992 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:34.421063 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:34.421351 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:34.421629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] PATH_INFO: `/v3/users/c664bd26a9604401955c4fe1cd4fd367` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:34.422836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c664bd26a9604401955c4fe1cd4fd367)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:34.424776 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:34.450645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:34.450939 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:34.451251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:34.469673 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:34.471000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:34.526432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1354/2686] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:19:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:34.538506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:34.539930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:34.574839 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c664bd26a9604401955c4fe1cd4fd367'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.587573 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c664bd26a9604401955c4fe1cd4fd367'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.609889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b7430-8469-4cd2-8626-6319f0840d66 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:34.615078 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:34.615756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:34.616041 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:34.616317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:34.624975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:34.626542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:34.634660 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1355/2687] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:19:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:19:34.658260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c664bd26a9604401955c4fe1cd4fd367'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.669171 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c664bd26a9604401955c4fe1cd4fd367'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.669877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-4b94663f-5b62-4723-a5c3-e4ed54614f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c664bd26a9604401955c4fe1cd4fd367'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:34.675982 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1333/2688] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:34 2022] DELETE /identity/v3/users/c664bd26a9604401955c4fe1cd4fd367 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:35.088156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.089602 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.103529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8338dc48-82a9-41e7-bd1e-2eb6326ddf72 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.155001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:35.164828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.165830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.171116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.171116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] PATH_INFO: `/v3/projects/bf381a8497704cecb1998d5bed731f97` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.171116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf381a8497704cecb1998d5bed731f97)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.171116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.214090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.214383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.214671 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.233365 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:35.234572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.297739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf381a8497704cecb1998d5bed731f97', 'request_id': 'req-e66ba42a-6ec1-4881-9258-4331e590dc2b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:35.299922 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1334/2689] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jul 25 06:19:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:35.304625 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf381a8497704cecb1998d5bed731f97', 'request_id': 'req-e66ba42a-6ec1-4881-9258-4331e590dc2b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:35.312837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.314919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.383487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c84f3-a6bc-4e28-a41b-0b553d1b29f5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.390064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf381a8497704cecb1998d5bed731f97', 'request_id': 'req-e66ba42a-6ec1-4881-9258-4331e590dc2b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:35.394478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:35.401857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] The token cache is being invalidate because project bf381a8497704cecb1998d5bed731f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:35.402143 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:35.402785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e66ba42a-6ec1-4881-9258-4331e590dc2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:35.404393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1356/2690] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:35 2022] DELETE /identity/v3/projects/bf381a8497704cecb1998d5bed731f97 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:35.409172 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbebd3-ca04-4e05-9afb-d0a941b6b474 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.409459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbebd3-ca04-4e05-9afb-d0a941b6b474 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.409737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbebd3-ca04-4e05-9afb-d0a941b6b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.428269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ddcbebd3-ca04-4e05-9afb-d0a941b6b474 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:35.429455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ddcbebd3-ca04-4e05-9afb-d0a941b6b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.449609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.452498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.452498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.452498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.454478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.513753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1357/2691] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:35.522438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.522789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.523076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.525214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.526952 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.543738 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1335/2692] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:19:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:19:35.545378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:35.546711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:35.555152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1358/2693] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:35.560045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.570777 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fc73c-e6f5-4ac0-89e9-5b684def0e4a service swift] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.576545 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.577217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.581061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.581061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.581061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:35.581061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.581061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.597173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1336/2694] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:35.598318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.608710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2d8398-5a06-4882-99f6-3da502a04e64 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.613740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.615342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.615342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.615342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.616628 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.617647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.729279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1359/2695] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:35 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:35.732835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.743004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e99f75-6ef2-446a-95ed-cd34e8ebc3ec admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.800998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.801672 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.801960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.802242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.802927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.804876 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.898115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1337/2696] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:35 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:35.907498 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.919184 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8af764-8c13-4746-b3b0-80a276a8ba0e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.924220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.924892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.927025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.927025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.927025 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.928067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.939335 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1360/2697] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:35.942991 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.954081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c7d86-5aa5-47a3-8771-565320f87fac admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.959079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.959831 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.960118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.960396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:35.961116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:35.963698 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cba2-30d7-4d9e-9ac3-7c70fe948614 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:35.974259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1338/2698] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:35.979015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:35.989891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce7f2a-0fa3-41bd-b7ef-075afc9e57bd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:35.995400 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:35.996409 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:35.996694 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:35.996975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] PATH_INFO: `/v3/projects/fc265ea6ce0e4ad6bc3a78b42c89bfdd/users/8567b3991ee64d849dbd2539770708d9/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.013579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc265ea6ce0e4ad6bc3a78b42c89bfdd, user_id=8567b3991ee64d849dbd2539770708d9, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.016529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a387a72-ebc5-4a3d-baa3-822211eeff09 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.076245 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1361/2699] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:35 2022] PUT /identity/v3/projects/fc265ea6ce0e4ad6bc3a78b42c89bfdd/users/8567b3991ee64d849dbd2539770708d9/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:36.086856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.087240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.087616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.114271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] MFA Rules not processed for user `8567b3991ee64d849dbd2539770708d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:36.115448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:36.116282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.116577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.116863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.125064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:36.136104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] MFA Rules not processed for user `b1dc332e02234697975d830116109efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:36.137370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:36.151657 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:36.186222 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1339/2700] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:36.190254 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.201909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1362/2701] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jul 25 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:36.214743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.216153 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:36.257186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1c74e-3d86-45e5-bfc7-52cca64ca67a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.262239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.262914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.263208 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.263492 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.264483 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.266469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.288921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd7193-6e82-4d5b-8d10-0551a7d2b587 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.294793 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '064b2b59c734411e81c488d505deb560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.295441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.295749 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.296028 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.304881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.307492 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.315431 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1363/2702] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jul 25 06:19:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 25 06:19:36.350298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1340/2703] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:36 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:36.354874 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.365190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629cc5e-fda6-4847-84f0-9f08e7e39192 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.422931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.423544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.423812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.424110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.424798 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.426679 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.498832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1364/2704] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:36 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:36.502821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.513556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4289262-987d-4bc2-becb-ca53140097dc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.518504 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.519168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.519456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.519767 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.520491 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.522091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.533583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1341/2705] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:36.537739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.549354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e0a15-feac-41c9-a195-50a49fa4b4d6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.553995 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.554920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.555208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.558427 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] PATH_INFO: `/v3/projects/0756b405d585451390b73f2c751c2787/users/006c3513eca740dca04576cce5701b70/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.570278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0756b405d585451390b73f2c751c2787, user_id=006c3513eca740dca04576cce5701b70, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.572964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.652799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1365/2706] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:36 2022] PUT /identity/v3/projects/0756b405d585451390b73f2c751c2787/users/006c3513eca740dca04576cce5701b70/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:36.656683 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.667902 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b6615-2063-4055-b569-cb11446b56f9 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.750543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.750543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.751389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.751389 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.752313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.754130 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7142-6f83-48a4-8941-b4b1726bfc05 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.766100 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1342/2707] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:36.770279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.784877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619772-2d20-4ba9-b61d-9bdaff169f46 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:36.792698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:36.793873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.794395 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.794832 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] PATH_INFO: `/v3/projects/0756b405d585451390b73f2c751c2787/users/006c3513eca740dca04576cce5701b70/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.797677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0756b405d585451390b73f2c751c2787, user_id=006c3513eca740dca04576cce5701b70, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:36.801565 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:36.813882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1366/2708] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:36 2022] PUT /identity/v3/projects/0756b405d585451390b73f2c751c2787/users/006c3513eca740dca04576cce5701b70/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:36.825511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:36.825811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:36.835503 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:36.869064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] MFA Rules not processed for user `006c3513eca740dca04576cce5701b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:36.869064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:36.869261 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:36.933603 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1343/2709] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:36.944843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:36.947339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:36.954360 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:37.008737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43d0a4-5cd3-458b-9604-c3585bc2be12 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:37.013282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:37.014364 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:37.014650 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:37.014927 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:37.024390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:37.026533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:37.037816 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1367/2710] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:37.174374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:37.184453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e06e4-d247-4355-ab29-08ad220bb5bb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:37.188112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:37.188782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:37.189056 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:37.189336 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:37.249298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:37.250707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee9928-8a6d-4a73-835a-3bb78fbe7370 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:37.260347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1344/2711] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:37.776896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:37.838845 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd653c-82d9-4931-bca1-1a7c86199105 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:37.844115 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:37.844700 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:37.845001 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:37.845281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] PATH_INFO: `/v3/users/8567b3991ee64d849dbd2539770708d9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:37.846527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8567b3991ee64d849dbd2539770708d9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:37.848490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:38.021256 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8567b3991ee64d849dbd2539770708d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.021842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8567b3991ee64d849dbd2539770708d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.022444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8567b3991ee64d849dbd2539770708d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.030545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8567b3991ee64d849dbd2539770708d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.044109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8567b3991ee64d849dbd2539770708d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.126937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1368/2712] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:37 2022] DELETE /identity/v3/users/8567b3991ee64d849dbd2539770708d9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:38.131658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:38.132217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:38.132217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:38.151709 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:38.152997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:38.215511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1345/2713] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:38.226993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:38.228767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:38.263337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:38.291838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10050e-4087-4432-85f8-d045e42cdb35 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:38.295506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:38.296181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:38.296465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:38.296740 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:38.305502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:38.308048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:38.317222 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1369/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:38.785137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:38.786568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:38.799900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8738446-cbb6-4dfb-b40c-4da231cf28c3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:38.806895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:38.806895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:38.806895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:38.806895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] PATH_INFO: `/v3/projects/fc265ea6ce0e4ad6bc3a78b42c89bfdd` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:38.808066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc265ea6ce0e4ad6bc3a78b42c89bfdd)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:38.810082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:38.909243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:38.916769 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc265ea6ce0e4ad6bc3a78b42c89bfdd', 'request_id': 'req-e9568219-489f-494c-a1ff-b068c3513d8f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.922291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc265ea6ce0e4ad6bc3a78b42c89bfdd', 'request_id': 'req-e9568219-489f-494c-a1ff-b068c3513d8f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:38.958089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:38.959636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:38.973042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa282b-129d-4e17-8020-5ad99d4efffc service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:38.995095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc265ea6ce0e4ad6bc3a78b42c89bfdd', 'request_id': 'req-e9568219-489f-494c-a1ff-b068c3513d8f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.007613 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] The token cache is being invalidate because project fc265ea6ce0e4ad6bc3a78b42c89bfdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:39.007914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.009270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.010946 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1346/2715] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:38 2022] DELETE /identity/v3/projects/fc265ea6ce0e4ad6bc3a78b42c89bfdd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:39.015387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:39.017341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:39.045201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:39.046206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:39.046495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:39.046770 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] PATH_INFO: `/v3/users/7d14bf60a4f94b8b9974c338a9572a51` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:39.048132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d14bf60a4f94b8b9974c338a9572a51)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:39.050161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:39.095477 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9568219-489f-494c-a1ff-b068c3513d8f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:39.100178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:39.101061 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:39.101763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:39.101763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] PATH_INFO: `/v3/users/006c3513eca740dca04576cce5701b70` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:39.102806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006c3513eca740dca04576cce5701b70)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:39.105374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:39.277824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d14bf60a4f94b8b9974c338a9572a51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.278475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d14bf60a4f94b8b9974c338a9572a51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.279128 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d14bf60a4f94b8b9974c338a9572a51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.285992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d14bf60a4f94b8b9974c338a9572a51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.297826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d14bf60a4f94b8b9974c338a9572a51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.392176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006c3513eca740dca04576cce5701b70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.404748 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006c3513eca740dca04576cce5701b70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.474975 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1370/2716] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:38 2022] DELETE /identity/v3/users/7d14bf60a4f94b8b9974c338a9572a51 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:39.475838 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:39.477154 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:39.530988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:39.534674 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e6a233-52f6-40f6-9300-48bc3651ecd0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:39.537852 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006c3513eca740dca04576cce5701b70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.538337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:39.538987 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:39.539272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:39.539570 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:39.541677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:39.545979 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006c3513eca740dca04576cce5701b70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.546639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-2792af0b-35a2-4e1d-8f24-4d152927c663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006c3513eca740dca04576cce5701b70'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:39.552879 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1347/2717] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:39 2022] DELETE /identity/v3/users/006c3513eca740dca04576cce5701b70 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:39.554270 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:39.554714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:39.555093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:39.574251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:39.575470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:39.620092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:39.635803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:39.637564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:39.642333 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1348/2718] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:39.654296 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:39.656749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:39.657165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1371/2719] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:39.723060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c2861-b08d-4afd-b45e-cf85cbabaff5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:39.727857 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:39.728631 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:39.729114 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:39.729961 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:39.741315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:39.743391 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:39.754557 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1349/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:39.990872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:39.992502 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.014892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.016620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.032194 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511a36c-5961-4b71-979d-a8efee9a256d service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.038612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.040235 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.040661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.042177 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] PATH_INFO: `/v3/projects/0cdf891503f44114ab41fca3f061080b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.043517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdf891503f44114ab41fca3f061080b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.046072 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.086080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc4ec4-0de7-4716-9037-b46045bffc6b service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.090899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.091837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.098280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.098280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] PATH_INFO: `/v3/projects/0756b405d585451390b73f2c751c2787` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.098280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0756b405d585451390b73f2c751c2787)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.098280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.167062 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdf891503f44114ab41fca3f061080b', 'request_id': 'req-94fa417e-344a-4681-8a97-6510e6522a90'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.172630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdf891503f44114ab41fca3f061080b', 'request_id': 'req-94fa417e-344a-4681-8a97-6510e6522a90'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.258362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0756b405d585451390b73f2c751c2787', 'request_id': 'req-0d861661-d003-485d-8cde-218d8b919618'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.263863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0756b405d585451390b73f2c751c2787', 'request_id': 'req-0d861661-d003-485d-8cde-218d8b919618'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.274993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdf891503f44114ab41fca3f061080b', 'request_id': 'req-94fa417e-344a-4681-8a97-6510e6522a90'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.286949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] The token cache is being invalidate because project 0cdf891503f44114ab41fca3f061080b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:40.287243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.287895 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-94fa417e-344a-4681-8a97-6510e6522a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.289427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1350/2721] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:40 2022] DELETE /identity/v3/projects/0cdf891503f44114ab41fca3f061080b => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:40.295020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921d3a-887d-4e73-9822-0379f64a073e None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.295312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921d3a-887d-4e73-9822-0379f64a073e None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.295640 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d921d3a-887d-4e73-9822-0379f64a073e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.313151 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-7d921d3a-887d-4e73-9822-0379f64a073e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:40.314266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-7d921d3a-887d-4e73-9822-0379f64a073e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.354559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0756b405d585451390b73f2c751c2787', 'request_id': 'req-0d861661-d003-485d-8cde-218d8b919618'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.371277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] The token cache is being invalidate because project 0756b405d585451390b73f2c751c2787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:40.371599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.373352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0d861661-d003-485d-8cde-218d8b919618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:40.373884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1372/2722] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:39 2022] DELETE /identity/v3/projects/0756b405d585451390b73f2c751c2787 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:40.377727 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1351/2723] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:40.378996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4cea-82ba-4ecb-9a97-81af70318141 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.379289 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4cea-82ba-4ecb-9a97-81af70318141 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.379619 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f4cea-82ba-4ecb-9a97-81af70318141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.383516 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.383843 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.384125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.398084 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-024f4cea-82ba-4ecb-9a97-81af70318141 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:40.399293 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-024f4cea-82ba-4ecb-9a97-81af70318141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.402846 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:40.404058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.408056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1373/2724] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:40.412464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1352/2725] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:40.415643 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.415791 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.416074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.416401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.426670 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8aeaa1-a1f6-4fbe-8c92-6e0a344e529b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.431334 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.432028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.432318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.432600 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.433398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:40.433707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.434889 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:40.435297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.436123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.436861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:40.444328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1374/2726] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:40.448794 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1353/2727] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:19:40.453476 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.456374 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.457777 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e8815-7130-4cc5-a065-bc772ae996ee None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.462497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119709-4475-43f3-8138-b597700660bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.463145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119709-4475-43f3-8138-b597700660bf admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.463430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119709-4475-43f3-8138-b597700660bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.463743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38119709-4475-43f3-8138-b597700660bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.465137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119709-4475-43f3-8138-b597700660bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:40.465441 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119709-4475-43f3-8138-b597700660bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.467017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38119709-4475-43f3-8138-b597700660bf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.467123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17587175-83f3-4b95-8358-92bd7b332321 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.468639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:40.473305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.474544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.475240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.475602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.476304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.478195 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.479453 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1375/2728] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:19:40.484526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119709-4475-43f3-8138-b597700660bf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.494310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38119709-4475-43f3-8138-b597700660bf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.498956 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.499617 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.499904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.500181 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.501038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.502978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.556330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1354/2729] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/projects => generated 399 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:40.560372 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.582254 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1376/2730] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:40.585351 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.622801 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc569d7-ecfb-479b-bdab-6d03f5565a83 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.649583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b3a2a-1590-45c1-b450-3e14dcb07a95 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.655064 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.655762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.656048 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.656544 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.657232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.659142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.681689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.682366 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.682652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.683013 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.683833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.691065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.733231 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1377/2731] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:40.737569 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.747572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb7836-cf9b-4cf8-aacf-87c3c9746fe9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.752330 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.756774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.756774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.756774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.756774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.756774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.767151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1378/2732] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:40.770888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.781799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1355/2733] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/users => generated 300 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:40.781999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f133c-c910-4675-8827-a76c07baa2d5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.782853 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.786608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.787274 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.787572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.787861 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.788599 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.790171 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.800724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1379/2734] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:40.806070 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.814612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b28b-643e-4d99-9e2e-5584aeb8cf31 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.819252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104849b3-2033-4b59-a697-3b41af634e3a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.820806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.821474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.821761 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.822045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.822768 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.824945 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.825444 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.826658 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.826945 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.827672 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] PATH_INFO: `/v3/projects/84d39a1f34ac4b48885f47f3d5790057/users/693a9014a7a94e5ca94496d598d2dcb9/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.835643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1356/2735] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:40.839908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.848260 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d39a1f34ac4b48885f47f3d5790057, user_id=693a9014a7a94e5ca94496d598d2dcb9, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.849832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76b670-9ca4-48ed-9bfb-1d0ac5471def admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.850909 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffaa46-1fbb-4093-89bf-4281c933db81 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.855312 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.856015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.856294 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.856572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.857292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.858866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.869187 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1357/2736] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:19:40.873554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:40.883496 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2722b-0564-4539-9204-823eb2e122bf admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:40.889825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:40.890716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.891010 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.891292 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] PATH_INFO: `/v3/projects/6541223bf9264eb48bb6d5addde99a50/users/bb6709789276421c86e8ac64c1b8a572/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.907196 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6541223bf9264eb48bb6d5addde99a50, user_id=bb6709789276421c86e8ac64c1b8a572, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:40.910874 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252fea4-6af7-4c73-9ed6-968f8bae9e3d admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:40.915443 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1380/2737] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:40 2022] PUT /identity/v3/projects/84d39a1f34ac4b48885f47f3d5790057/users/693a9014a7a94e5ca94496d598d2dcb9/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:40.926021 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.926310 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.926587 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:40.954631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] MFA Rules not processed for user `693a9014a7a94e5ca94496d598d2dcb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:40.955882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:40.978990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1358/2738] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:40 2022] PUT /identity/v3/projects/6541223bf9264eb48bb6d5addde99a50/users/bb6709789276421c86e8ac64c1b8a572/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:40.990239 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:40.990523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:40.990804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:41.018464 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] MFA Rules not processed for user `bb6709789276421c86e8ac64c1b8a572`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:41.019714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:41.023419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1381/2739] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:41.035038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:41.036433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:41.037744 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:41.043005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:41.087134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1359/2740] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:19:41.094797 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4fb72-0c83-465b-9cc1-8080178b7232 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:41.100287 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:41.101655 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:41.154168 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:41.154822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:41.155114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:41.155393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:41.168971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a481a6e-ac79-4b5b-a409-7d125b1952e8 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:41.172873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:41.173320 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:41.173606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:41.173877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:41.182662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:41.184785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:41.194687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1360/2741] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:41.213096 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:41.219137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f88a8e-cc99-4130-9863-d22e8fc6ca7c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:41.225016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1382/2742] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:19:48.267687 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:48.329037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa1e94-61b9-4100-a406-bc8b88c15369 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:48.334383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:48.337953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:48.337953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:48.337953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] PATH_INFO: `/v3/users/bb6709789276421c86e8ac64c1b8a572` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:48.337953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb6709789276421c86e8ac64c1b8a572)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:48.338974 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:48.516739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb6709789276421c86e8ac64c1b8a572'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:48.523805 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:48.529783 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb6709789276421c86e8ac64c1b8a572'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:48.588443 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb6709789276421c86e8ac64c1b8a572'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:48.596851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb6709789276421c86e8ac64c1b8a572'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:48.597488 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb6709789276421c86e8ac64c1b8a572'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:48.603997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1361/2743] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:48 2022] DELETE /identity/v3/users/bb6709789276421c86e8ac64c1b8a572 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:48.610369 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:48.610864 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:48.610992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:48.628362 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:48.629600 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:48.689711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1383/2744] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:48.699630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:48.701423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:48.757752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0a8f4-9d98-404b-b35f-1c0ffb48cd2f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:48.761426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:48.762060 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:48.762343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:48.762627 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:48.772621 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:48.774044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f7aa4-79fe-4b7a-a54a-71d093a6b096 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:48.784124 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1362/2745] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:49.196342 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.197762 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:49.210610 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38958076-779d-4898-ae1b-a7866b43cdf9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.215161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.216059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.216339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.216613 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] PATH_INFO: `/v3/projects/6541223bf9264eb48bb6d5addde99a50` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.217850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6541223bf9264eb48bb6d5addde99a50)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.219947 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:49.231388 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:49.322508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6541223bf9264eb48bb6d5addde99a50', 'request_id': 'req-472a275f-e069-4685-b50e-6c378641fd60'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:49.329856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6541223bf9264eb48bb6d5addde99a50', 'request_id': 'req-472a275f-e069-4685-b50e-6c378641fd60'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:49.417572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6541223bf9264eb48bb6d5addde99a50', 'request_id': 'req-472a275f-e069-4685-b50e-6c378641fd60'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:49.429481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] The token cache is being invalidate because project 6541223bf9264eb48bb6d5addde99a50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:19:49.429920 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:49.430527 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-472a275f-e069-4685-b50e-6c378641fd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:19:49.432127 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1384/2746] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:19:49 2022] DELETE /identity/v3/projects/6541223bf9264eb48bb6d5addde99a50 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:49.437054 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c525-3921-4f84-b728-75d54659185a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.438170 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c525-3921-4f84-b728-75d54659185a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.438291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7c525-3921-4f84-b728-75d54659185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.457577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-76b7c525-3921-4f84-b728-75d54659185a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:49.458718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-76b7c525-3921-4f84-b728-75d54659185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:49.517678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1363/2747] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:49.526063 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.526195 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.526447 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.545003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:49.546194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:49.554828 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1385/2748] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:49.559162 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7c525-3921-4f84-b728-75d54659185a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.569712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7c525-3921-4f84-b728-75d54659185a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.574298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:19:49.576988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.578262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:49.594425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1364/2749] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:19:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:19:49.595869 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.605054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d4d73-5f12-4c33-86ad-f06cf36f888e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.610682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.611705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.611705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.611888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.612574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.614439 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:49.745062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1386/2750] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:49 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:49.749311 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.760983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987937df-995c-4bce-9277-3e214e4f36a0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.819018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.819733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.820046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.820328 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.821030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.822932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:49.831474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:49.932546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1365/2751] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:49 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:19:49.936711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.947162 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25955dd-8c7a-4688-bb34-3eb4fe56b2ad admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.951792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.952450 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.952748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.953033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.953756 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.955341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:49.969976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1387/2752] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:49.972692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:49.982674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1859813-8a5d-483a-b31a-b7bad22fe5ce admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:49.988057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:49.988718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:49.994827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:49.994827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:49.994827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:49.994827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72a65f-00b7-425f-a6d0-dfa9f46e9fe5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:50.002094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1366/2753] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:50.006383 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:50.016692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81fa736-f30a-40e7-b608-55449eb7726e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:50.021883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:50.022355 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:50.022635 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:50.022910 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] PATH_INFO: `/v3/projects/6eac8597927c4b33ac02c113b33eb9da/users/1f230ff343724c07a2c5248106491846/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:50.043393 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eac8597927c4b33ac02c113b33eb9da, user_id=1f230ff343724c07a2c5248106491846, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:50.046109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:50.132252 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1388/2754] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:50 2022] PUT /identity/v3/projects/6eac8597927c4b33ac02c113b33eb9da/users/1f230ff343724c07a2c5248106491846/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:19:50.137318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785161a-25e8-4eac-a1a5-e7342a1a1de7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:50.137607 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785161a-25e8-4eac-a1a5-e7342a1a1de7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:50.137917 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785161a-25e8-4eac-a1a5-e7342a1a1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:50.155762 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-b785161a-25e8-4eac-a1a5-e7342a1a1de7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:50.157986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-b785161a-25e8-4eac-a1a5-e7342a1a1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:50.232462 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1367/2755] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:50.242266 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:50.244129 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:50.303815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa51eab-427a-40d7-9ece-8da026eec9b8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:50.307539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:50.308218 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:50.308501 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:50.308988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:50.323738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:50.323738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:50.331372 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1389/2756] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:55.708058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:55.708602 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:55.708735 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:55.738015 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] MFA Rules not processed for user `1f230ff343724c07a2c5248106491846`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:19:55.739301 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:55.814728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1368/2757] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:19:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:19:55.819468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:55.831735 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb901-4e9e-4e8c-98a5-28cb0ced8e74 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:55.840572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:55.840572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:55.840572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:55.840572 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:55.841016 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:55.841308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:55.927898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1390/2758] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:19:55 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:55.933729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:55.946091 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebaa648-e493-4598-a5cd-8304345782e2 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:56.034069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:56.034755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:56.035058 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:56.035399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:56.036133 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:56.038217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:56.116112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1369/2759] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:19:55 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:19:56.120185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:56.131104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405c287-9d4c-48a4-b2c5-f54a4b8c5be3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:56.135500 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:56.136224 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:56.136514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:56.136792 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:56.137507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:56.139378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:56.150540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1391/2760] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:56.154666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:56.160688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:56.166620 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fdfd5-f076-4567-82d0-9115734fc19a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:56.172849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:56.179469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:56.179469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:56.179469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] PATH_INFO: `/v3/projects/772eb6e27c4c4131b1746340f011ed64/users/afe697f2b9e546a2a247836714af0837/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:56.190577 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772eb6e27c4c4131b1746340f011ed64, user_id=afe697f2b9e546a2a247836714af0837, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:56.193524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:56.263820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1370/2761] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:56 2022] PUT /identity/v3/projects/772eb6e27c4c4131b1746340f011ed64/users/afe697f2b9e546a2a247836714af0837/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:56.277339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:56.284429 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:19:56.288093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6031-79b0-45af-84ee-256ee92f5d78 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:56.342789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:56.343448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:56.344319 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:56.344596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:56.345312 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:56.346993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:56.357261 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1392/2762] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:19:56.361661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:56.372199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2567-946e-4a4e-bb35-0805469f0961 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:56.376990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:56.377871 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:56.378152 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:56.378426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] PATH_INFO: `/v3/projects/772eb6e27c4c4131b1746340f011ed64/users/afe697f2b9e546a2a247836714af0837/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:56.380451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772eb6e27c4c4131b1746340f011ed64, user_id=afe697f2b9e546a2a247836714af0837, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:56.383108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:56.394716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1371/2763] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:19:56 2022] PUT /identity/v3/projects/772eb6e27c4c4131b1746340f011ed64/users/afe697f2b9e546a2a247836714af0837/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:19:57.710707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:57.785998 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2e756-f4e3-4de0-9919-2f31a5f2d74d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:57.852529 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:57.853535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:57.853821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:57.854103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:57.855999 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:57.869745 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:57.871204 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b9517-ae82-49ea-a2c2-166a07734260 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:19:57.881306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1393/2764] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:19:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:19:59.756083 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:19:59.758071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:19:59.845214 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebaf1fd-9ef8-4852-92ae-f2d64b6d6e09 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:19:59.851343 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:19:59.852705 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:19:59.853237 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:19:59.853819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] PATH_INFO: `/v3/users/693a9014a7a94e5ca94496d598d2dcb9` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:19:59.857080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693a9014a7a94e5ca94496d598d2dcb9)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:19:59.863514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:00.103674 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693a9014a7a94e5ca94496d598d2dcb9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:00.122592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693a9014a7a94e5ca94496d598d2dcb9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:00.206379 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693a9014a7a94e5ca94496d598d2dcb9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:00.214942 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693a9014a7a94e5ca94496d598d2dcb9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:00.215913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693a9014a7a94e5ca94496d598d2dcb9'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:00.223658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1372/2765] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:19:59 2022] DELETE /identity/v3/users/693a9014a7a94e5ca94496d598d2dcb9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:20:00.228003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:00.228508 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:00.229561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:00.249075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:20:00.252926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:00.311474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:00.321161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1394/2766] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:20:00.331277 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:00.332822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:00.387543 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:00.402793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f74d59e-0f54-4136-8f29-7cc7035b14a3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:00.407356 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:00.408126 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:00.410739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:00.410739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:00.424630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:00.426268 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad25c7-c698-40b2-a96c-9073529404a3 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:00.445421 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1373/2767] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:00.911710 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:00.913758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:00.938232 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91532394-21ae-4c15-b952-edaa581aa08c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:00.944778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:00.945830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:00.946223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:00.946608 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] PATH_INFO: `/v3/projects/84d39a1f34ac4b48885f47f3d5790057` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:00.948219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d39a1f34ac4b48885f47f3d5790057)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:00.950277 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:01.075848 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d39a1f34ac4b48885f47f3d5790057', 'request_id': 'req-1e4e4d5d-e993-4345-a013-46bce0ca4743'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:01.085047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d39a1f34ac4b48885f47f3d5790057', 'request_id': 'req-1e4e4d5d-e993-4345-a013-46bce0ca4743'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:01.144481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d39a1f34ac4b48885f47f3d5790057', 'request_id': 'req-1e4e4d5d-e993-4345-a013-46bce0ca4743'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:01.163353 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] The token cache is being invalidate because project 84d39a1f34ac4b48885f47f3d5790057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:20:01.163760 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:01.164782 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:20:01.167017 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1395/2768] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:20:00 2022] DELETE /identity/v3/projects/84d39a1f34ac4b48885f47f3d5790057 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:20:02.461203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7cfb-6ca1-4424-afd7-964f23eda206 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:02.461789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7cfb-6ca1-4424-afd7-964f23eda206 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:02.461908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c7cfb-6ca1-4424-afd7-964f23eda206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:02.492014 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e97c7cfb-6ca1-4424-afd7-964f23eda206 None None] MFA Rules not processed for user `afe697f2b9e546a2a247836714af0837`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:20:02.493257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e97c7cfb-6ca1-4424-afd7-964f23eda206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:02.567528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1374/2769] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:20:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:20:02.581397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:02.582921 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:02.670488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e4d5d-e993-4345-a013-46bce0ca4743 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:02.677868 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:02.678550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:02.678833 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:02.679107 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:02.680957 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:02.743391 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:02.744952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:02.754844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1396/2770] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:05.528808 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:05.529297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:05.529396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:05.551412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] MFA Rules not processed for user `1f230ff343724c07a2c5248106491846`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:20:05.552691 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:05.559752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1375/2771] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:20:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:20:12.750438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:15.543720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=43 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:23.450923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:23.452407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:23.509276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac12ef-58e8-4461-bf6a-decf872b9ee3 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:23.512829 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:23.513468 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:23.514019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:23.514294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:23.516039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:23.525990 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:23.527385 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:23.536300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1397/2772] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:24.296322 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:24.297789 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:24.370165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab545375-d73b-4bf7-8177-eb139777f00b None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:24.375318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:24.376073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:24.376360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:24.376639 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:24.379029 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:24.390749 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:24.392349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:24.403101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1376/2773] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:28.270528 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:28.285292 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad4b3e-377a-4c28-a8f5-9c30a545fdf3 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:28.291183 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:28.291946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:28.292301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:28.292649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:28.294588 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:28.308746 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:28.310437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:28.324378 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1398/2774] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:34.398689 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=32 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:34.806763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:34.808243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:34.823360 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202d03e-67aa-4f5f-9cba-cb24c1f2230c service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:34.828819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:34.829459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:34.829746 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:34.830024 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:34.831962 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:34.843819 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:34.845375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:34.856341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1377/2775] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:38.318010 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=32 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:38.370161 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:38.380130 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673bb41-4f6f-400a-97b0-d6f9aaa96ce0 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:38.383720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:38.384357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:38.384639 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:38.384913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:38.394149 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:38.395485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddecac6-9f2a-4eb9-9259-747f8430b769 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:38.404813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1399/2776] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:40.632169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:20:40.643654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b66d9-b554-487e-83a5-929e465f2324 service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:20:40.649519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:20:40.650164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:20:40.650451 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:20:40.650731 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:20:40.652561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:20:40.664980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:20:40.666569 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:20:40.678535 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1378/2777] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:20:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:20:48.400693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:20:50.673559 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=12 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:21:11.356561 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:21:11.357103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:21:11.357103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:21:11.374822 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] MFA Rules not processed for user `afd54465bfa5482cb252080d845022af`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:21:11.376137 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:21:11.430493 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1400/2778] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:21:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:21:11.728435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:21:11.730046 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:21:11.741367 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba0c6-0c86-4251-9fdc-ea85e52859ad service nova] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:21:11.744914 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:21:11.745552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:21:11.745835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:21:11.746110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:21:11.747867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:21:11.757756 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:21:11.759161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:21:11.767469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1379/2779] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:21:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 06:21:21.423899 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=25 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:21:21.763916 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=6 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:22:42.869521 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:22:42.882979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33341-909c-49b8-aff8-a8f4964f021a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:22:42.889005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53925cdf5a744200910943966d84ed40', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:22:42.889646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:22:42.889940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:22:42.890247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:22:42.892053 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:22:42.903361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:22:42.905377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:22:42.914054 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1401/2780] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:22:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:22:52.909811 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:00.352316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:00.365842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734547a-269d-408b-82eb-52af4ffaeb2b service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:00.372161 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:00.372923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:00.373285 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:00.373654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:00.375616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:00.389017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:00.390630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:00.401814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1380/2781] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:06.097891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:06.107771 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0a268-47fa-41a5-b4f2-577f0157ae7c service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:06.111311 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:06.111988 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:06.112276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:06.112558 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:06.114308 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:06.175872 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:06.177286 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:06.187614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1402/2782] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:09.793988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:09.795427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:09.812397 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3467c77-f89d-4ff5-b0e8-1689ba7ed6cb service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:09.817460 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:09.818108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:09.818439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:09.818708 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:09.820497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:09.833679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:09.835271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:09.848298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1381/2783] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:09.952187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:09.953881 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:09.968406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604a7563-5918-48e5-a489-94dbeb80e1c5 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:09.972993 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:09.973935 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:09.974220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:09.974495 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] PATH_INFO: `/v3/users/afd54465bfa5482cb252080d845022af` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:09.975704 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd54465bfa5482cb252080d845022af)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:09.977589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:10.177671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd54465bfa5482cb252080d845022af'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.178327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd54465bfa5482cb252080d845022af'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.178944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd54465bfa5482cb252080d845022af'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.185883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd54465bfa5482cb252080d845022af'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.197507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d6c40f41-d2b5-4dcf-9317-8e61cf0e50cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd54465bfa5482cb252080d845022af'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.278074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1403/2784] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:23:09 2022] DELETE /identity/v3/users/afd54465bfa5482cb252080d845022af => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:10.530928 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:10.542009 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0bfbe-ef63-4ac5-abce-6234688694b7 service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:10.600023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:10.600889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:10.601172 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:10.601452 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] PATH_INFO: `/v3/projects/6fba62e6f00d41318359dcda25034608` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:10.602625 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fba62e6f00d41318359dcda25034608)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:10.605043 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:10.717284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fba62e6f00d41318359dcda25034608', 'request_id': 'req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.722716 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fba62e6f00d41318359dcda25034608', 'request_id': 'req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.780282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fba62e6f00d41318359dcda25034608', 'request_id': 'req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.791272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] The token cache is being invalidate because project 6fba62e6f00d41318359dcda25034608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:23:10.791584 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.792223 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-3f5d8a72-a037-4c72-b78c-f8fcb29f8195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:10.793759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1382/2785] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:23:10 2022] DELETE /identity/v3/projects/6fba62e6f00d41318359dcda25034608 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:10.798903 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:10.799201 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:10.799486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:10.818216 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:10.819403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:10.876893 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1404/2786] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:10.885212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f86f-01f7-4490-a675-10c95999531a None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:10.886363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f86f-01f7-4490-a675-10c95999531a None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:10.886461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649f86f-01f7-4490-a675-10c95999531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:10.905578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-e649f86f-01f7-4490-a675-10c95999531a None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:10.906785 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-e649f86f-01f7-4490-a675-10c95999531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:10.914597 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1383/2787] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:23:10.918967 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:10.928741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26697f-92a2-40f7-abf8-28010029e4fd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:10.934062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:10.934716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:10.935008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:10.935290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:10.936052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:23:10.936365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:10.937961 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:10.939452 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:10.950752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1405/2788] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:23:10.955070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649f86f-01f7-4490-a675-10c95999531a None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:10.964712 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649f86f-01f7-4490-a675-10c95999531a None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:10.969615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:10.970271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:10.970558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:10.970837 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:10.971523 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:10.973548 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.073576 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1384/2789] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:23:10 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:11.077952 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.088116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8cfe0-8198-4bfd-b512-4190b5f576ab admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.144812 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.145477 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.145761 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.146040 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.146732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.148647 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.255113 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1406/2790] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:23:11 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:11.259330 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.271106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de8157-0800-48b1-84b5-a0b46d0789fc admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.275964 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.276646 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.277580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.277877 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.278792 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.280423 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.291685 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1385/2791] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:11.296055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.306775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc97f6-4b53-4f4c-9c4a-7eac58931f51 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.312131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.312786 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.313071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.313356 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.314082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.315713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c18d00-04ce-4077-98e3-ca4107da901f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.326283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1407/2792] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:11.330553 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.341568 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4df146-28d5-454b-96dc-d758d797aef0 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.346280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.347160 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.347448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.347758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] PATH_INFO: `/v3/projects/cab17699a3f849608d3d73e5d27f8af8/users/eabb151fdb29406bb40372d436a9b143/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.362378 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cab17699a3f849608d3d73e5d27f8af8, user_id=eabb151fdb29406bb40372d436a9b143, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.365089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.438629 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:11.443428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1386/2793] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:11 2022] PUT /identity/v3/projects/cab17699a3f849608d3d73e5d27f8af8/users/eabb151fdb29406bb40372d436a9b143/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:11.454485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.454485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.454718 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.483186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] MFA Rules not processed for user `eabb151fdb29406bb40372d436a9b143`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:11.484433 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:11.557681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1408/2794] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:11.567741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.626020 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df64faf-4647-412a-a964-00f921bbc3a4 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.630772 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.631432 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.631753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.632032 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.632714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.634643 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.718118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1387/2795] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:23:11 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:23:11.722114 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.733002 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27943ac-d8c2-44b9-acce-85bd94fe036c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.789706 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.790401 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.790687 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.790966 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.791722 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.794152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.801738 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:11.861074 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1409/2796] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:23:11 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:11.864758 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.876449 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bd810-390b-4285-8907-efba52c0234e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.881168 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.881866 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.882153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.882433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.883158 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.884820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:11.895788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1388/2797] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:11.899919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:11.910131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e5189-f990-4dd8-9824-bb719911bed1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:11.914847 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:11.915752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:11.916022 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:11.916295 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] PATH_INFO: `/v3/projects/a7271e5351f74fce8405d0f0888a87e6/users/d4ef6786d24844bc87125119b9aa28c5/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:11.931305 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7271e5351f74fce8405d0f0888a87e6, user_id=d4ef6786d24844bc87125119b9aa28c5, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:11.934649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:12.004038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1410/2798] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:11 2022] PUT /identity/v3/projects/a7271e5351f74fce8405d0f0888a87e6/users/d4ef6786d24844bc87125119b9aa28c5/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:12.008081 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:12.018242 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9787a415-7945-4101-b718-fb59b774e808 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:12.075044 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:12.075678 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:12.075993 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:12.076275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:12.077006 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:12.078592 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6364b-5345-4af5-a6c4-99b79875392b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:12.088606 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1389/2799] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:12.092813 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:12.102978 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80e16f-43f8-4965-b2b6-4b17306f6ed6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:12.108538 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:12.109413 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:12.109691 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:12.109964 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] PATH_INFO: `/v3/projects/a7271e5351f74fce8405d0f0888a87e6/users/d4ef6786d24844bc87125119b9aa28c5/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:12.111953 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7271e5351f74fce8405d0f0888a87e6, user_id=d4ef6786d24844bc87125119b9aa28c5, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:12.114547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:12.125595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1411/2800] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:12 2022] PUT /identity/v3/projects/a7271e5351f74fce8405d0f0888a87e6/users/d4ef6786d24844bc87125119b9aa28c5/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:12.135383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:12.135707 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:12.136022 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:12.162331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] MFA Rules not processed for user `d4ef6786d24844bc87125119b9aa28c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:12.163544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:12.221904 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:12.230526 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1390/2801] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:12.242291 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:12.244179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:12.300890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667248c-03ed-4822-a094-ccebbd1efdb8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:12.304485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:12.305139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:12.305421 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:12.305697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:12.315159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:12.316632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:12.326361 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1412/2802] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:12.478198 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:12.488844 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017f5a1-49c4-42ca-8026-e108edd34ed5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:12.492394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:12.493038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:12.493401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:12.493681 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:12.550037 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:12.551479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:12.560781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1391/2803] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:20.262469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:20.264058 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:20.324596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283731b-c4ed-4fca-8f81-633fcba91924 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:20.328976 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:20.329634 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:20.329923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:20.330285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:20.332208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:20.341831 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:20.343294 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:20.351206 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1413/2804] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:20.425887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:20.427445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:20.440673 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b83078-379b-4086-8ecc-31b9ce025574 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:20.444251 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:20.444897 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:20.445188 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:20.445469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:20.447245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:20.517669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:20.519102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3483a-e69f-4665-8754-bcce3ce1c1af service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:20.529997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1392/2805] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:30.347693 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=4,keystone:SELECT=69 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:30.525123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=64 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:49.301788 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:49.364403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c901b91-73f5-4b79-846b-6e54f976eba1 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:49.369123 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:49.370050 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:49.370336 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:49.370614 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] PATH_INFO: `/v3/users/eabb151fdb29406bb40372d436a9b143` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:49.371842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabb151fdb29406bb40372d436a9b143)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:49.373783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:49.530047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabb151fdb29406bb40372d436a9b143'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:49.530624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabb151fdb29406bb40372d436a9b143'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:49.531300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabb151fdb29406bb40372d436a9b143'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:49.539188 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabb151fdb29406bb40372d436a9b143'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:49.551121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabb151fdb29406bb40372d436a9b143'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:49.613145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1414/2806] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:23:49 2022] DELETE /identity/v3/users/eabb151fdb29406bb40372d436a9b143 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:49.617612 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:49.618137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:49.618280 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:49.637266 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:49.638482 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:49.698034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1393/2807] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:49.708324 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:49.709734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:49.766844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33c100-159d-416a-9f49-7dafe2a4c36c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:49.771069 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:49.771751 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:49.772042 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:49.772326 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:49.781414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:49.782814 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:49.792350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1415/2808] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:50.164125 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:50.165666 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:50.178694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b05555-8060-4496-83fb-4aa39bdea427 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:50.183272 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:50.184298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:50.184609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:50.184890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] PATH_INFO: `/v3/projects/cab17699a3f849608d3d73e5d27f8af8` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:50.186080 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cab17699a3f849608d3d73e5d27f8af8)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:50.188017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:50.272510 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cab17699a3f849608d3d73e5d27f8af8', 'request_id': 'req-a5363f9c-e99d-41a4-87b7-23ece0c8b129'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.277984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cab17699a3f849608d3d73e5d27f8af8', 'request_id': 'req-a5363f9c-e99d-41a4-87b7-23ece0c8b129'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.333051 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cab17699a3f849608d3d73e5d27f8af8', 'request_id': 'req-a5363f9c-e99d-41a4-87b7-23ece0c8b129'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.344305 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] The token cache is being invalidate because project cab17699a3f849608d3d73e5d27f8af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:23:50.344594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.345228 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.347649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1394/2809] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:23:50 2022] DELETE /identity/v3/projects/cab17699a3f849608d3d73e5d27f8af8 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:50.351753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:50.363930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe1b217-c9af-45db-8220-7b5d5b174c58 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:50.382152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:50.420815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:50.421684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:50.421968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:50.422244 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] PATH_INFO: `/v3/users/d4ef6786d24844bc87125119b9aa28c5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:50.423430 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ef6786d24844bc87125119b9aa28c5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:50.426004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:50.628145 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ef6786d24844bc87125119b9aa28c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.628727 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ef6786d24844bc87125119b9aa28c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.629386 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ef6786d24844bc87125119b9aa28c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.636692 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ef6786d24844bc87125119b9aa28c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.649697 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d60b29d1-daf3-4a8e-8b26-48cb57d3d57c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ef6786d24844bc87125119b9aa28c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:50.715913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1416/2810] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:23:50 2022] DELETE /identity/v3/users/d4ef6786d24844bc87125119b9aa28c5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:51.135167 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.136684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:51.153375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5363f9c-e99d-41a4-87b7-23ece0c8b129 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.211753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.212659 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.212975 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.213225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] PATH_INFO: `/v3/projects/a7271e5351f74fce8405d0f0888a87e6` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.214412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7271e5351f74fce8405d0f0888a87e6)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.216344 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.341398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:51.356953 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7271e5351f74fce8405d0f0888a87e6', 'request_id': 'req-b36bc206-58e7-480f-a047-55392ee0e478'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:51.362282 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7271e5351f74fce8405d0f0888a87e6', 'request_id': 'req-b36bc206-58e7-480f-a047-55392ee0e478'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:51.430923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7271e5351f74fce8405d0f0888a87e6', 'request_id': 'req-b36bc206-58e7-480f-a047-55392ee0e478'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:51.443810 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] The token cache is being invalidate because project a7271e5351f74fce8405d0f0888a87e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:23:51.444099 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:51.444719 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-b36bc206-58e7-480f-a047-55392ee0e478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:23:51.446245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1395/2811] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:23:51 2022] DELETE /identity/v3/projects/a7271e5351f74fce8405d0f0888a87e6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:51.451104 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.451596 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.451723 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.470366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:51.472247 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:51.531193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1417/2812] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:51.539892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.540183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.540466 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.558329 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:51.559645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:51.568888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1396/2813] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:51.573101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.584212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc3d63-12e9-4f4c-aece-c103270d7fe3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.589850 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.590519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.590810 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.591093 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.591902 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:23:51.592214 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.593877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.606539 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1418/2814] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:23:51.610799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.620747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b54c4b-a666-4563-afe2-93cc695202eb None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.625494 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.628238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.628238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.628238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.628238 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.629832 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.712511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1397/2815] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:23:51 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:51.716730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.727366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd8c10-f9b3-49ed-9341-a2120ff6d3ed admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.753630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:51.785217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.785876 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.786187 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.786462 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.787148 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.789079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.910554 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1419/2816] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:23:51 2022] POST /identity/v3/users => generated 294 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:51.914630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.925094 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598140-b85f-4be0-ac34-63a3fcf1d36c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.930127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.930804 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.931088 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.931394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.932184 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.933806 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.944987 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1398/2817] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:51.948896 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.959854 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc7c2cb-6c9b-45e5-b3b0-c5ec93b2d82a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.964535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.965193 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.965479 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.965759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:51.966486 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:51.968106 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9673e695-339d-48e8-abba-b9c7ed322e29 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:51.978101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1420/2818] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:23:51.982086 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:51.992108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95ea94-7cc1-48a2-8126-945a96677e2f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:51.996752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:51.997628 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:51.997906 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:51.998185 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] PATH_INFO: `/v3/projects/68cdd46bd3da4186aeb72bebc2e24a63/users/55cec4c4d18f4984a26e0334b5898923/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.013728 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cdd46bd3da4186aeb72bebc2e24a63, user_id=55cec4c4d18f4984a26e0334b5898923, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.016459 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.100446 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1399/2819] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:51 2022] PUT /identity/v3/projects/68cdd46bd3da4186aeb72bebc2e24a63/users/55cec4c4d18f4984a26e0334b5898923/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:52.110671 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.110968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.111253 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.138352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] MFA Rules not processed for user `55cec4c4d18f4984a26e0334b5898923`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:52.139582 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:52.202908 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1421/2820] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:52.207512 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.268542 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33282e-a572-4135-b0e0-066988ae2b57 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.273437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.274089 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.274380 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.274657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.275401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.277313 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.351973 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1400/2821] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/projects => generated 387 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:52.356197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.367515 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52856e6-3f02-4a09-acc5-0bcf017602d8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.422951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.423649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.423940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.424906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.425633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.427532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.511075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1422/2822] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:52.515338 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.526275 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465ad87-ef19-4d68-a0a4-01467f7ffb92 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.530889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.531616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.531950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.532260 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.532988 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.535090 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.545645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1401/2823] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:52.550152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.560194 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595c1c6-b6a6-4263-8359-52834fea78e7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.564787 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.565550 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.565837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.566120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.566837 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.568446 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c309178-d92b-4c09-a110-070ece1dc30a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.578303 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1423/2824] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:52.582323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.592755 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b620fa-6173-4a5c-aa16-01c65c9b2ced admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.597948 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.598812 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.599095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.599370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] PATH_INFO: `/v3/projects/aa4b256a9289464aa443a0e71a5692e3/users/83b21cc6b5054289a7598dece2014abf/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.614064 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa4b256a9289464aa443a0e71a5692e3, user_id=83b21cc6b5054289a7598dece2014abf, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.616743 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.706718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:52.711410 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1402/2825] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:52 2022] PUT /identity/v3/projects/aa4b256a9289464aa443a0e71a5692e3/users/83b21cc6b5054289a7598dece2014abf/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:52.723006 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.723309 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.723662 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.750067 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] MFA Rules not processed for user `83b21cc6b5054289a7598dece2014abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:52.751280 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:52.755357 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:52.816038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1424/2826] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:52.820425 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:52.881190 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d4f4a-7cb4-429c-a494-286a02541158 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:52.886472 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:52.887393 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:52.887714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:52.887998 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:52.888695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:52.890590 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:52.986715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1403/2827] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:23:52.990914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.002003 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f3b79-283c-4b9b-88fa-89c767fd3fb0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.059739 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.060414 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.060698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.060973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.061670 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.064024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.127937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1425/2828] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:23:52 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:23:53.131893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.142478 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652320f6-8626-4aff-b6c1-ce962525d7d3 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.148001 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.148665 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.148950 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.149248 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.149947 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.151529 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.162711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1404/2829] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:53.166659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.176597 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2db100-b601-4d5d-9a64-e3b46bc48f22 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.181178 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.182047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.182332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.182609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] PATH_INFO: `/v3/projects/0b4d169bddb84affb147bba1ae28ee27/users/9892dd083ae544d5b93eec9852617c91/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.198014 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4d169bddb84affb147bba1ae28ee27, user_id=9892dd083ae544d5b93eec9852617c91, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.200681 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.271649 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1426/2830] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:53 2022] PUT /identity/v3/projects/0b4d169bddb84affb147bba1ae28ee27/users/9892dd083ae544d5b93eec9852617c91/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:53.275825 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.286661 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59171d7-7cb7-4339-b252-4b7b2e09cb52 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.341445 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.342106 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.342387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.342662 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.343375 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.345457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9681e-9847-4ecf-982a-4a0f2f5f05d3 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.355318 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1405/2831] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:23:53.364583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.374892 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8558-93f7-45be-9d2d-0b12c7be555c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.379780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.380605 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.380891 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.381170 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] PATH_INFO: `/v3/projects/0b4d169bddb84affb147bba1ae28ee27/users/9892dd083ae544d5b93eec9852617c91/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.383152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4d169bddb84affb147bba1ae28ee27, user_id=9892dd083ae544d5b93eec9852617c91, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.385821 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.396258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1427/2832] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:23:53 2022] PUT /identity/v3/projects/0b4d169bddb84affb147bba1ae28ee27/users/9892dd083ae544d5b93eec9852617c91/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:23:53.406164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.406457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.406741 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.434468 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] MFA Rules not processed for user `9892dd083ae544d5b93eec9852617c91`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:23:53.435693 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:53.492814 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:53.502045 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1406/2833] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:23:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:23:53.512970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:53.515669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:53.571803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3c541-7baf-4b40-8796-078c1eedeafa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:53.575488 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:53.576160 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:53.576448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:53.576728 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:53.585918 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:53.587332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:53.592269 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:23:53.597856 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1428/2834] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:54.446519 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:54.450199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:23:54.460649 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33808941-0a2b-426e-8eeb-aae52f66cb60 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:54.464136 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:54.464773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:54.465053 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:54.465326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:54.522417 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:54.523908 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:54.532910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1407/2835] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:23:59.246142 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:23:59.255299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889951c0-ea57-44ba-81b2-c23612ff8846 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:23:59.259255 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:23:59.259944 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:23:59.260228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:23:59.260504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:23:59.318399 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:23:59.320208 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82081f3a-9cb1-4c35-89a3-654d335c37bb service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:23:59.329535 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1429/2836] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:23:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:02.980340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:03.044101 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4348d1-7e6f-454a-96fa-42605a717f7d service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:03.048787 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:03.050178 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:03.050457 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:03.050788 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] PATH_INFO: `/v3/users/55cec4c4d18f4984a26e0334b5898923` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:03.052071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55cec4c4d18f4984a26e0334b5898923)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:03.054354 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:03.220782 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55cec4c4d18f4984a26e0334b5898923'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:03.232750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55cec4c4d18f4984a26e0334b5898923'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:03.293123 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55cec4c4d18f4984a26e0334b5898923'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:03.300558 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55cec4c4d18f4984a26e0334b5898923'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:03.301225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55cec4c4d18f4984a26e0334b5898923'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:03.307733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1408/2837] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:02 2022] DELETE /identity/v3/users/55cec4c4d18f4984a26e0334b5898923 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:03.312542 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:03.313059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:03.313163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:03.331676 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:03.332888 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:03.391803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1430/2838] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:03.402085 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:03.403485 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:03.417955 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:03.461438 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea5e84-4eda-4df3-98aa-55be34b250e2 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:03.465288 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:03.465937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:03.466231 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:03.466514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:03.477092 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:03.478530 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:03.488960 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1409/2839] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:03.906055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:03.907471 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:03.919606 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000c436-e2eb-4c70-ab39-b771cb76ee89 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:03.924632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:03.925504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:03.925783 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:03.926055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] PATH_INFO: `/v3/projects/68cdd46bd3da4186aeb72bebc2e24a63` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:03.927285 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cdd46bd3da4186aeb72bebc2e24a63)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:03.929190 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:04.044147 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cdd46bd3da4186aeb72bebc2e24a63', 'request_id': 'req-ac09234a-89f4-4999-8047-b5c36aad58c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.049965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cdd46bd3da4186aeb72bebc2e24a63', 'request_id': 'req-ac09234a-89f4-4999-8047-b5c36aad58c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.111082 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cdd46bd3da4186aeb72bebc2e24a63', 'request_id': 'req-ac09234a-89f4-4999-8047-b5c36aad58c5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.123520 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] The token cache is being invalidate because project 68cdd46bd3da4186aeb72bebc2e24a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:04.123849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.124496 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.126329 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1431/2840] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:03 2022] DELETE /identity/v3/projects/68cdd46bd3da4186aeb72bebc2e24a63 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:04.130790 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:04.141763 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e8de8-3d3e-4929-8b5c-55e02dbf3734 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:04.200608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:04.201470 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:04.201759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:04.202034 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] PATH_INFO: `/v3/users/83b21cc6b5054289a7598dece2014abf` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:04.203199 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83b21cc6b5054289a7598dece2014abf)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:04.205134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:04.400913 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83b21cc6b5054289a7598dece2014abf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.414706 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83b21cc6b5054289a7598dece2014abf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.499370 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83b21cc6b5054289a7598dece2014abf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.507940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83b21cc6b5054289a7598dece2014abf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.508630 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83b21cc6b5054289a7598dece2014abf'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:04.517240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1410/2841] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:04 2022] DELETE /identity/v3/users/83b21cc6b5054289a7598dece2014abf => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:05.226624 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:05.228220 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:05.250474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09234a-89f4-4999-8047-b5c36aad58c5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:05.272246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:05.313404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:05.314200 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:05.314491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:05.315341 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] PATH_INFO: `/v3/projects/aa4b256a9289464aa443a0e71a5692e3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:05.318808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa4b256a9289464aa443a0e71a5692e3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:05.318808 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:05.407929 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa4b256a9289464aa443a0e71a5692e3', 'request_id': 'req-cfd02e61-a5d9-466c-a12c-611fdce235fe'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.413870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa4b256a9289464aa443a0e71a5692e3', 'request_id': 'req-cfd02e61-a5d9-466c-a12c-611fdce235fe'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.453118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa4b256a9289464aa443a0e71a5692e3', 'request_id': 'req-cfd02e61-a5d9-466c-a12c-611fdce235fe'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.464804 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] The token cache is being invalidate because project aa4b256a9289464aa443a0e71a5692e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:05.465087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.465759 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.467338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1432/2842] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:05 2022] DELETE /identity/v3/projects/aa4b256a9289464aa443a0e71a5692e3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:05.471422 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:05.473018 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:05.486364 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4e677-bfc5-42f1-9a3a-135624a66e15 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:05.520004 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:05.544456 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:05.545340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:05.546293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:05.546578 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] PATH_INFO: `/v3/users/9892dd083ae544d5b93eec9852617c91` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:05.547824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9892dd083ae544d5b93eec9852617c91)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:05.549822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:05.697873 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9892dd083ae544d5b93eec9852617c91'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.710534 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9892dd083ae544d5b93eec9852617c91'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.795747 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9892dd083ae544d5b93eec9852617c91'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.802888 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9892dd083ae544d5b93eec9852617c91'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.803517 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-d5320a8f-eb03-4b16-8d12-12b586fdf968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9892dd083ae544d5b93eec9852617c91'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:05.809440 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1411/2843] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:05 2022] DELETE /identity/v3/users/9892dd083ae544d5b93eec9852617c91 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:06.169023 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.170448 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:06.184223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd02e61-a5d9-466c-a12c-611fdce235fe admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.240914 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.241774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.242052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.242325 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] PATH_INFO: `/v3/projects/0b4d169bddb84affb147bba1ae28ee27` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.243511 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4d169bddb84affb147bba1ae28ee27)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.245419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.321698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4d169bddb84affb147bba1ae28ee27', 'request_id': 'req-b044cd72-15b2-4013-80df-15b47c13a8a6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:06.325748 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:06.328056 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4d169bddb84affb147bba1ae28ee27', 'request_id': 'req-b044cd72-15b2-4013-80df-15b47c13a8a6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:06.362514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4d169bddb84affb147bba1ae28ee27', 'request_id': 'req-b044cd72-15b2-4013-80df-15b47c13a8a6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:06.374251 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] The token cache is being invalidate because project 0b4d169bddb84affb147bba1ae28ee27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:06.374579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:06.375180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b044cd72-15b2-4013-80df-15b47c13a8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:06.376741 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1433/2844] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:06 2022] DELETE /identity/v3/projects/0b4d169bddb84affb147bba1ae28ee27 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:06.383824 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.384119 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.384427 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.403797 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:06.405023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:06.469211 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1412/2845] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:06.529789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.530081 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.530363 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.549318 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:06.550534 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:06.558632 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1434/2846] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:06.562688 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.572827 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dacfbc-1bac-46a6-88da-1c72e6577d91 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.577752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.578411 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.578700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.578983 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.579752 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:24:06.580069 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.582278 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.593695 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1413/2847] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:24:06.598354 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.607675 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07221e0-6c9c-4a8d-8ce4-48cdccd142a8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.612583 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.613259 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.613549 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.613830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.614525 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.616463 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.723641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1435/2848] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:06 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:06.727798 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.738461 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a922ec2-42e0-48f9-9a9c-a3c3360e7e84 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.779121 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:06.795209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.795893 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.796176 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.796453 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.797139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.799173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.921551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1414/2849] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:06 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:06.925714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.936118 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc219fb-1cdf-40c2-b79e-5769c7463bee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.941192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.941842 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.942124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.942397 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.943110 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.944705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.954996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1436/2850] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:06.959544 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:06.969586 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec5745-2323-447f-a7b8-a1a980a75b5a admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:06.974506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:06.975108 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:06.975396 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:06.975714 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:06.976444 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:06.978112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4eff5-2fe4-44a3-ae3b-68dc1796632b admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:06.988537 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1415/2851] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:06.992533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.003302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721720a9-b5be-42fd-a88f-c6a769df298b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.008072 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.008980 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.009264 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.009540 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] PATH_INFO: `/v3/projects/152753c062fe4c28963ccc07113fac6e/users/a9e9ff00913e460fb49a6e9470c802b2/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.024886 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=152753c062fe4c28963ccc07113fac6e, user_id=a9e9ff00913e460fb49a6e9470c802b2, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.027514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.094801 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1437/2852] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:06 2022] PUT /identity/v3/projects/152753c062fe4c28963ccc07113fac6e/users/a9e9ff00913e460fb49a6e9470c802b2/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:07.106684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.106986 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.107257 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.135648 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] MFA Rules not processed for user `a9e9ff00913e460fb49a6e9470c802b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:07.137115 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:07.204226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1416/2853] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:24:07.209630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.275108 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b58a2-bb04-41c2-b41b-ca9c158bf3fa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.279965 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.280698 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.280996 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.281270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.281968 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.284094 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.409321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1438/2854] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:07 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:07.413402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.423956 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df3738-796f-409f-a753-bfbfcc4e3be3 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.479608 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.480291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.480580 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.480862 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.481588 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.483528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.562042 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1417/2855] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:07 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:24:07.566300 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.576781 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5819e-40d4-4c1e-87c5-2b177b65aa21 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.581982 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.582645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.582934 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.588352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.588352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.588352 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.597125 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1439/2856] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:07.601066 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.611000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1621845e-7cb7-48ed-8962-00d65df850c8 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.617030 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.617169 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.617339 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.617624 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] PATH_INFO: `/v3/projects/b9a265127ff94474b686516472ece378/users/5b834003a85f42f8b55061cf150f387e/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.631887 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a265127ff94474b686516472ece378, user_id=5b834003a85f42f8b55061cf150f387e, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.634511 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.723387 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1418/2857] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:07 2022] PUT /identity/v3/projects/b9a265127ff94474b686516472ece378/users/5b834003a85f42f8b55061cf150f387e/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:07.727328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.738547 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659f0be-67f0-4baa-8deb-4c9c8c7c8d5d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.785817 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:07.794131 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.794834 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.795116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.795396 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.796139 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.797729 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703c20e-54ac-47bf-9239-be1b382a5321 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.808478 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1440/2858] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:07.812657 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.823079 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edcb2b-ab61-48f6-88c2-be1a505de01c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:07.827676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:07.828554 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.828835 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.829153 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] PATH_INFO: `/v3/projects/b9a265127ff94474b686516472ece378/users/5b834003a85f42f8b55061cf150f387e/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.831499 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a265127ff94474b686516472ece378, user_id=5b834003a85f42f8b55061cf150f387e, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:07.834157 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:07.844497 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1419/2859] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:07 2022] PUT /identity/v3/projects/b9a265127ff94474b686516472ece378/users/5b834003a85f42f8b55061cf150f387e/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:24:07.860505 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:07.860800 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:07.861089 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:07.887730 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] MFA Rules not processed for user `5b834003a85f42f8b55061cf150f387e`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:07.888933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:07.956636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1441/2860] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:07.973969 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:07.975676 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:07.980929 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:08.035615 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30c171-26f2-4e0c-a9c8-8bf919010350 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:08.039299 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:08.040000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:08.040324 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:08.040610 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:08.050404 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:08.051892 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:08.062073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1420/2861] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:08.167424 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:08.178038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7b014-f7ca-4a78-bdc9-b74213a0bb13 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:08.181595 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:08.182258 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:08.182545 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:08.182824 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:08.239209 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:08.240669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684245f-c3f5-40c5-88a6-7ba8dd2d378b service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:08.249435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1442/2862] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:11.290836 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:11.353316 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070aef90-3f0a-420b-a3af-52635a611391 service cinder] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:11.357937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:11.358833 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:11.359155 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:11.359439 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] PATH_INFO: `/v3/users/a9e9ff00913e460fb49a6e9470c802b2` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:11.360694 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e9ff00913e460fb49a6e9470c802b2)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:11.363546 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:11.541669 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e9ff00913e460fb49a6e9470c802b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:11.553889 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e9ff00913e460fb49a6e9470c802b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:11.619057 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e9ff00913e460fb49a6e9470c802b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:11.626116 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e9ff00913e460fb49a6e9470c802b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:11.626739 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e9ff00913e460fb49a6e9470c802b2'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:11.633098 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1421/2863] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:11 2022] DELETE /identity/v3/users/a9e9ff00913e460fb49a6e9470c802b2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:11.637992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:11.645659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:11.645659 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:11.656481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:11.657778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:11.717734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1443/2864] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:11.727680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:11.729150 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:11.758112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:11.786829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282eae1-ff63-4b13-b95a-4b8794c07c5c admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:11.790710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:11.791349 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:11.791664 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:11.792016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:11.801556 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:11.803065 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:11.812509 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1422/2865] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:12.151732 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:12.153283 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:12.165857 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3260d-4ade-4271-bf73-40ce73af46db None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:12.170557 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:12.171435 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:12.171758 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:12.172038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] PATH_INFO: `/v3/projects/152753c062fe4c28963ccc07113fac6e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:12.178720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=152753c062fe4c28963ccc07113fac6e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:12.178720 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:12.183830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:12.259358 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152753c062fe4c28963ccc07113fac6e', 'request_id': 'req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.265111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152753c062fe4c28963ccc07113fac6e', 'request_id': 'req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.321644 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152753c062fe4c28963ccc07113fac6e', 'request_id': 'req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.334020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] The token cache is being invalidate because project 152753c062fe4c28963ccc07113fac6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:12.334306 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.339275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.339275 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1444/2866] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:12 2022] DELETE /identity/v3/projects/152753c062fe4c28963ccc07113fac6e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:12.340532 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:12.350903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7188b13c-41a0-44cb-bbcd-09a7ce72d8c5 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:12.411697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:12.412574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:12.412860 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:12.413138 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] PATH_INFO: `/v3/users/5b834003a85f42f8b55061cf150f387e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:12.414340 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b834003a85f42f8b55061cf150f387e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:12.416283 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:12.535660 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b834003a85f42f8b55061cf150f387e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.547412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b834003a85f42f8b55061cf150f387e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.590206 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b834003a85f42f8b55061cf150f387e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.597766 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b834003a85f42f8b55061cf150f387e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.598428 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-98863678-27a8-4295-bec1-f8fbb7c98375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b834003a85f42f8b55061cf150f387e'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:12.604469 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1423/2867] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:12 2022] DELETE /identity/v3/users/5b834003a85f42f8b55061cf150f387e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:12.969192 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:12.970707 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:12.985004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e53a8-cc1a-4976-bec1-9c039a54a8e4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.046645 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.047523 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.047839 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.048120 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] PATH_INFO: `/v3/projects/b9a265127ff94474b686516472ece378` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.049365 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a265127ff94474b686516472ece378)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.051282 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.156387 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a265127ff94474b686516472ece378', 'request_id': 'req-e80f62e0-42d2-4c16-ae8a-8889d4d07097'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:13.161769 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a265127ff94474b686516472ece378', 'request_id': 'req-e80f62e0-42d2-4c16-ae8a-8889d4d07097'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:13.218799 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a265127ff94474b686516472ece378', 'request_id': 'req-e80f62e0-42d2-4c16-ae8a-8889d4d07097'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:13.230320 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] The token cache is being invalidate because project b9a265127ff94474b686516472ece378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:13.230609 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:13.231228 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e80f62e0-42d2-4c16-ae8a-8889d4d07097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:13.232958 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1445/2868] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:12 2022] DELETE /identity/v3/projects/b9a265127ff94474b686516472ece378 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:13.238641 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.238954 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.239236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.259143 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:13.260820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:13.302881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:13.320435 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1424/2869] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:13.329406 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.329716 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.330004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.348237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:13.349469 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:13.364464 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1446/2870] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:13.368720 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.379012 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdeeba3-29c0-4608-ad67-b55cb047cdc5 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.383809 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.384474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.384759 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.385038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.385773 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80338) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:24:13.386110 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.388049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.400259 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1425/2871] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:24:13.404474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.413882 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db83e4-d900-4146-a52a-9ec60e56e81b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.418485 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.419132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.419419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.419742 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.420491 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.422367 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.493564 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:13.500682 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1447/2872] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:13.505817 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.516097 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3b444-b2d8-4a61-990d-6c47b6dfe061 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.573179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.573851 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.574137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.574418 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.575111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.577052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.635634 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1426/2873] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:13.639946 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.651073 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89997cf2-1ab6-4389-a394-a322f4d80532 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.655919 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.656585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.656873 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.657155 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.657884 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.660037 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.670176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1448/2874] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:13.674082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.684633 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3197364-15ca-4e0f-880a-0897a018e632 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.689264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.689923 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.690209 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.690490 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.691203 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.692829 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b1ddc-ccde-43be-b9dc-cc209942ca29 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.702757 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1427/2875] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:13.707005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.716950 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c64ad-1c39-4512-aa3f-5ee0a12a7f2f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.722035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.722913 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.723197 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.723474 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] PATH_INFO: `/v3/projects/872ed051d8a643bb911348ba494789e3/users/c867ee17955f49ac9c1f3c8e8e4d837c/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.738347 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=872ed051d8a643bb911348ba494789e3, user_id=c867ee17955f49ac9c1f3c8e8e4d837c, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.741011 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:13.812612 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1449/2876] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:13 2022] PUT /identity/v3/projects/872ed051d8a643bb911348ba494789e3/users/c867ee17955f49ac9c1f3c8e8e4d837c/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:13.822919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.823215 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.823528 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.849910 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] MFA Rules not processed for user `c867ee17955f49ac9c1f3c8e8e4d837c`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:13.851117 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:13.915376 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1428/2877] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:13.919849 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:13.982789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec90177-c4c8-4ca2-87d3-acfdbecdc62f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:13.988465 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:13.994321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:13.994321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:13.994321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:13.994321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:13.994321 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.078237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1450/2878] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:13 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:14.082302 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.093102 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2a08b-f539-4669-b0e3-d696e08993c4 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.135291 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:14.151454 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.152156 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.152437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.152715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] PATH_INFO: `/v3/users` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.153402 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.155297 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.265135 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1429/2879] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:14 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:14.268989 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.279930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dc0dd8-68fe-4a42-95f4-8a05771751dd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.286667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.291287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.291287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.291287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.291287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.291287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.301870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1451/2880] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:14.305919 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.316050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac79d9-028f-4ed0-9b7e-85751ba7a38e admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.320733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.321609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.321949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.322229 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] PATH_INFO: `/v3/projects/bffe173344534d9a99e3ca07a6535f0b/users/f6cb0cf64f6245db9c94babea8894d0b/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.337507 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffe173344534d9a99e3ca07a6535f0b, user_id=f6cb0cf64f6245db9c94babea8894d0b, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.340200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.414017 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1430/2881] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:14 2022] PUT /identity/v3/projects/bffe173344534d9a99e3ca07a6535f0b/users/f6cb0cf64f6245db9c94babea8894d0b/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:24:14.417931 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.428272 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4434154-edc8-44b4-9389-f4869f70dc6b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.486159 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.486830 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.487124 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.487407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.488186 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.490575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f03a91-a1ee-47fb-8195-09e70494a6c9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.500715 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1452/2882] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:14.504818 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.515591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02938344-6fc4-4975-8f34-3e01be2ff974 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.520159 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.521552 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.521834 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.522134 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] PATH_INFO: `/v3/projects/bffe173344534d9a99e3ca07a6535f0b/users/f6cb0cf64f6245db9c94babea8894d0b/roles/9af7a97541544183a2fd12ef8ccb62b5` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.524164 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=bffe173344534d9a99e3ca07a6535f0b, user_id=f6cb0cf64f6245db9c94babea8894d0b, role_id=9af7a97541544183a2fd12ef8ccb62b5)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.526775 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.537362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1431/2883] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:14 2022] PUT /identity/v3/projects/bffe173344534d9a99e3ca07a6535f0b/users/f6cb0cf64f6245db9c94babea8894d0b/roles/9af7a97541544183a2fd12ef8ccb62b5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:14.548695 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.548992 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.549281 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.576085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] MFA Rules not processed for user `f6cb0cf64f6245db9c94babea8894d0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:14.577677 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:14.597904 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:14.649092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1453/2884] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:14.659635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:14.661377 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:14.719095 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaa4a5-ac0a-42d7-b701-256468c981ad admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:14.722697 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:14.723463 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:14.723778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:14.724566 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:14.778652 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:14.780033 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d5e1c-7938-4dcb-8e7f-c8b727ae1f0e service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:14.789395 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1432/2885] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:17.818121 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:17.879080 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b84e33-1f85-4ba7-a486-1f6229c3a4c9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:17.883737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:17.884598 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:17.884877 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:17.885151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] PATH_INFO: `/v3/users/c867ee17955f49ac9c1f3c8e8e4d837c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:17.886898 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c867ee17955f49ac9c1f3c8e8e4d837c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:17.888818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:18.141775 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c867ee17955f49ac9c1f3c8e8e4d837c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.142390 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c867ee17955f49ac9c1f3c8e8e4d837c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.143008 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c867ee17955f49ac9c1f3c8e8e4d837c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.151176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c867ee17955f49ac9c1f3c8e8e4d837c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.163923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c867ee17955f49ac9c1f3c8e8e4d837c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.218669 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1454/2886] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:17 2022] DELETE /identity/v3/users/c867ee17955f49ac9c1f3c8e8e4d837c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:18.223240 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:18.223778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:18.223900 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:18.242200 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:18.243403 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:18.287129 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:18.302071 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1433/2887] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:18.311683 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:18.313083 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:18.357404 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:18.372339 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc9d1-a700-44bf-b9c2-de9ad747f026 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:18.375933 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:18.376580 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:18.376870 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:18.377152 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:18.387087 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:18.388559 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:18.398684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1455/2888] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:18.814753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:18.816293 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:18.829684 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6416aae-6adc-443b-96e4-a1440631d4ee None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:18.834635 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:18.835506 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:18.835821 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:18.836137 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] PATH_INFO: `/v3/projects/872ed051d8a643bb911348ba494789e3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:18.837314 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] RBAC: Authorizing `identity:delete_project(project_id=872ed051d8a643bb911348ba494789e3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:18.839224 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:18.974323 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872ed051d8a643bb911348ba494789e3', 'request_id': 'req-45c92d95-0362-4446-be2b-7a53e297573f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:18.980591 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872ed051d8a643bb911348ba494789e3', 'request_id': 'req-45c92d95-0362-4446-be2b-7a53e297573f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.064711 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872ed051d8a643bb911348ba494789e3', 'request_id': 'req-45c92d95-0362-4446-be2b-7a53e297573f'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.077686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] The token cache is being invalidate because project 872ed051d8a643bb911348ba494789e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:19.077972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.078594 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.080165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1434/2889] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:18 2022] DELETE /identity/v3/projects/872ed051d8a643bb911348ba494789e3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:19.084752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:19.094713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75053e-93f6-415e-a130-083f45d523af service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:19.152009 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:19.152936 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:19.153212 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:19.153490 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] PATH_INFO: `/v3/users/f6cb0cf64f6245db9c94babea8894d0b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:19.154684 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cb0cf64f6245db9c94babea8894d0b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:19.156631 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:19.324156 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cb0cf64f6245db9c94babea8894d0b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.324803 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cb0cf64f6245db9c94babea8894d0b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.325402 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cb0cf64f6245db9c94babea8894d0b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.332403 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cb0cf64f6245db9c94babea8894d0b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.344951 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-830815e5-a4ab-44bd-877b-f5d7ff6015b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cb0cf64f6245db9c94babea8894d0b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.407101 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1456/2890] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:19 2022] DELETE /identity/v3/users/f6cb0cf64f6245db9c94babea8894d0b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:19.797186 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:19.798795 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:19.812382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c92d95-0362-4446-be2b-7a53e297573f admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:19.869616 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:19.870484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:19.870771 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:19.871050 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] PATH_INFO: `/v3/projects/bffe173344534d9a99e3ca07a6535f0b` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:19.872243 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bffe173344534d9a99e3ca07a6535f0b)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:19.874140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:19.979182 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bffe173344534d9a99e3ca07a6535f0b', 'request_id': 'req-926b1645-7417-49c2-81bd-a38789697422'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:19.984822 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bffe173344534d9a99e3ca07a6535f0b', 'request_id': 'req-926b1645-7417-49c2-81bd-a38789697422'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:20.070551 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bffe173344534d9a99e3ca07a6535f0b', 'request_id': 'req-926b1645-7417-49c2-81bd-a38789697422'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:20.083361 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] The token cache is being invalidate because project bffe173344534d9a99e3ca07a6535f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:20.084075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:20.084780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-926b1645-7417-49c2-81bd-a38789697422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:20.086346 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1435/2891] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:19 2022] DELETE /identity/v3/projects/bffe173344534d9a99e3ca07a6535f0b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:20.091237 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.091721 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.091844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.110753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:20.111974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:20.163883 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:20.172249 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1457/2892] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:20.180793 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.181082 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.181363 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.187732 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:20.199750 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:20.200935 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:20.208803 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1436/2893] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 06:24:20.213974 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.223533 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f07a6a4-3e9c-4d84-b307-69aa8373d40c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.229091 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.229743 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.230027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.230302 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.231024 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:24:20.231328 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.232938 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.244504 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1458/2894] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 06:24:20.248778 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.257949 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c0164-c453-4c95-9f45-5f76d170b9c6 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.262999 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.263679 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.263966 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.264245 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.264971 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.266856 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.362934 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1437/2895] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:20 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 06:24:20.373033 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.383019 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fce7-6173-4958-bf39-04389f690639 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.439236 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.439930 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.440219 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.440497 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.441185 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.443085 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.521499 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1459/2896] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:20 2022] POST /identity/v3/users => generated 285 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:20.526111 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.536369 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31126c-44f6-460d-8767-9ae49d06e157 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.541700 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.542401 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.542686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.542963 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.543717 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.545298 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.555409 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1438/2897] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:20.559279 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.569419 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696cd14-71de-447e-94d1-b245f24f51c3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.574734 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.575389 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.575726 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.576005 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.576753 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.578307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2fa3be-28e5-4c18-9c63-c09e00d54a03 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.589711 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1460/2898] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:20.593605 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.604039 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c2c89-69a6-4efb-8e33-c502f7706cb5 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.608539 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.609407 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.609690 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.609965 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] PATH_INFO: `/v3/projects/adf09373a0644128be1ca17b935f362d/users/a0d6b835fd80456792d2bb77bb15c1a0/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.624132 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf09373a0644128be1ca17b935f362d, user_id=a0d6b835fd80456792d2bb77bb15c1a0, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.626723 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.738250 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1439/2899] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:20 2022] PUT /identity/v3/projects/adf09373a0644128be1ca17b935f362d/users/a0d6b835fd80456792d2bb77bb15c1a0/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:24:20.748438 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.753297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.753297 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.775897 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] MFA Rules not processed for user `a0d6b835fd80456792d2bb77bb15c1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:20.777099 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:20.840415 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1461/2900] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:20.852321 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:20.854227 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:20.931087 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54da4b-8b7f-47cd-8ba8-267926071328 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:20.934715 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed6cf63615e341518b142f986915e404', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:20.935347 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:20.935658 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:20.935936 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:20.944112 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:20.945514 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909747f-0ea6-4197-81ab-a1e06b96b146 service glance] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:20.954780 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1440/2901] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:30.836633 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:30.950820 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=61,keystone:INSERT=2 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:47.892179 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:47.956481 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4707-6113-41fa-bb7b-0ad369704f1c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:47.960906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:47.961778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:47.962062 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:47.962337 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] PATH_INFO: `/v3/users/a0d6b835fd80456792d2bb77bb15c1a0` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:47.963506 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d6b835fd80456792d2bb77bb15c1a0)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:47.974039 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:48.147004 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d6b835fd80456792d2bb77bb15c1a0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.147526 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d6b835fd80456792d2bb77bb15c1a0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.148165 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d6b835fd80456792d2bb77bb15c1a0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.155059 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d6b835fd80456792d2bb77bb15c1a0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.166737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d6b835fd80456792d2bb77bb15c1a0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.263755 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1462/2902] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:47 2022] DELETE /identity/v3/users/a0d6b835fd80456792d2bb77bb15c1a0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:48.268448 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:48.268940 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:48.269049 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:48.286256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:48.287474 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:48.345394 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1441/2903] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:48.355055 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:48.356507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:48.414467 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e255a-61e6-4e6e-b06f-589d108abf0d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:48.418007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:48.418653 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:48.418940 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:48.419226 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:48.428163 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:48.429579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c4573-75ca-4c3b-8648-869da4b5742b service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:48.438984 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1463/2904] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:48.819331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:48.819331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:48.828527 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a4a62c-31be-46da-868d-2b2e7880a5d7 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:48.833304 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:48.834179 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:48.836028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:48.836028 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] PATH_INFO: `/v3/projects/adf09373a0644128be1ca17b935f362d` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:48.836236 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf09373a0644128be1ca17b935f362d)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:48.837972 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:48.915140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf09373a0644128be1ca17b935f362d', 'request_id': 'req-1f76c4c1-2037-4f41-944b-1da2476cf1e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.920598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf09373a0644128be1ca17b935f362d', 'request_id': 'req-1f76c4c1-2037-4f41-944b-1da2476cf1e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.978433 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf09373a0644128be1ca17b935f362d', 'request_id': 'req-1f76c4c1-2037-4f41-944b-1da2476cf1e4'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.990571 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] The token cache is being invalidate because project adf09373a0644128be1ca17b935f362d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:48.990861 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.991484 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-1f76c4c1-2037-4f41-944b-1da2476cf1e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:48.993052 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1442/2905] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:48 2022] DELETE /identity/v3/projects/adf09373a0644128be1ca17b935f362d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:48.998068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:48.998514 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:48.998696 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.017630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:49.018815 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:49.035714 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:49.079574 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1464/2906] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:49.088306 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.091881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.091881 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.107675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:49.109455 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:49.117703 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1443/2907] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:49.122035 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.132844 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54942a53-4309-49a6-80ec-4d713c43b937 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.137818 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.138475 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.138765 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.139047 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.140065 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 06:24:49.140377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.141979 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.153459 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1465/2908] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jul 25 06:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 06:24:49.157968 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.167609 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a11fecf-0c60-4217-bab3-0ee8458231bd None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.172990 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.173645 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.173932 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.174212 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] PATH_INFO: `/v3/projects` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.174905 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.176848 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.265811 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1444/2909] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jul 25 06:24:49 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:49.270126 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.281000 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4d30-b379-4b01-9b62-7ff3a79e17b2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.337029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.337705 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.338029 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.338437 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.339136 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.341103 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.453134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1466/2910] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jul 25 06:24:49 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 06:24:49.457265 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.468431 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20511ad-4fd5-4bc1-8bf5-b6f858334945 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.473226 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.473886 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.474173 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.474487 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.475326 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.477023 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.489221 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1445/2911] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 06:24:49.493223 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.503585 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab31b2-c7bc-4115-a3ab-2e5509f84542 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.508267 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.508923 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.509241 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.509519 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.510271 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.512151 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a705349-e27f-4b7d-be75-6a1e4e452be5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.522371 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1467/2912] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jul 25 06:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 06:24:49.526315 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.536729 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f56b0-bacb-4fed-ba1b-c34c18015b66 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.541276 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.542139 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.542416 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.542686 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] PATH_INFO: `/v3/projects/119f14b888d4405ea8e53e0290bc26f3/users/1571fa00c43c492a90a8a0bbe36a3dd3/roles/dfc30452d78d40f6911291710cd6601e` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.557382 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=119f14b888d4405ea8e53e0290bc26f3, user_id=1571fa00c43c492a90a8a0bbe36a3dd3, role_id=dfc30452d78d40f6911291710cd6601e)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.560038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.647675 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1446/2913] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jul 25 06:24:49 2022] PUT /identity/v3/projects/119f14b888d4405ea8e53e0290bc26f3/users/1571fa00c43c492a90a8a0bbe36a3dd3/roles/dfc30452d78d40f6911291710cd6601e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 06:24:49.658489 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.658789 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.659075 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.685134 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] MFA Rules not processed for user `1571fa00c43c492a90a8a0bbe36a3dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:49.686338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:49.751350 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1468/2914] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:49.762753 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.765093 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:49.787680 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:49.821284 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5d384-a2b8-4dd3-a5d4-9eb0b709b2fe admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.824927 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f429ab936824983b32150cd5c181210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.828140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.828140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.828140 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.834784 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.836256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a239c-90ac-45f6-8cf4-5015c9eb1976 service cinder] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:49.845903 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1447/2915] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:49.869317 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:49.888859 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:24:49.933344 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8de99-a921-4fa1-93ff-6bec69e2203f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:49.938826 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:49.939737 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:49.940027 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:49.940307 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] PATH_INFO: `/v3/users/1571fa00c43c492a90a8a0bbe36a3dd3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:49.941507 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1571fa00c43c492a90a8a0bbe36a3dd3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:49.943455 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:50.145630 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1571fa00c43c492a90a8a0bbe36a3dd3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.146290 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1571fa00c43c492a90a8a0bbe36a3dd3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.146906 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1571fa00c43c492a90a8a0bbe36a3dd3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.153780 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1571fa00c43c492a90a8a0bbe36a3dd3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.166276 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1571fa00c43c492a90a8a0bbe36a3dd3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.224217 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1469/2916] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:24:49 2022] DELETE /identity/v3/users/1571fa00c43c492a90a8a0bbe36a3dd3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:24:50.228997 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] REQUEST_METHOD: `POST` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:50.229383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:50.229781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:50.247894 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.auth.core [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] MFA Rules not processed for user `606c52ef106342ea90cee3defca6b7ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80338) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 06:24:50.249192 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:50.307373 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1448/2917] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jul 25 06:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 06:24:50.316937 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:50.318377 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:50.375963 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a49660-552c-45a5-b3f2-4c5afc9b3aa0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:50.379663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:50.380314 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:50.380604 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:50.380890 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:50.390807 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:50.392287 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:50.401736 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1470/2918] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:24:50.820264 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:24:50.822016 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:24:50.836781 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3debad-4d40-4114-8fd0-f4cd6bbbb308 None None] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:24:50.841650 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:24:50.842524 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:24:50.842880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:24:50.843220 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] PATH_INFO: `/v3/projects/119f14b888d4405ea8e53e0290bc26f3` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:24:50.844437 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119f14b888d4405ea8e53e0290bc26f3)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:24:50.846399 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:24:50.956598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119f14b888d4405ea8e53e0290bc26f3', 'request_id': 'req-f9d0bf19-e352-430f-adeb-dde70fcd5f50'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:50.962127 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119f14b888d4405ea8e53e0290bc26f3', 'request_id': 'req-f9d0bf19-e352-430f-adeb-dde70fcd5f50'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:51.046816 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119f14b888d4405ea8e53e0290bc26f3', 'request_id': 'req-f9d0bf19-e352-430f-adeb-dde70fcd5f50'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:51.059000 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] The token cache is being invalidate because project 119f14b888d4405ea8e53e0290bc26f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:24:51.059290 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:51.059930 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:24:51.061531 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1449/2919] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:24:50 2022] DELETE /identity/v3/projects/119f14b888d4405ea8e53e0290bc26f3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:25:00.397503 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:01.055774 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:04.344970 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:04.354568 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f257f-e76a-4530-9587-84041c6f693f service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:04.403941 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:04.404579 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:04.404863 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:04.405304 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:04.407071 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:04.467246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:04.468778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:04.477922 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1471/2920] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:05.511073 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:05.512598 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:05.526419 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0bf19-e352-430f-adeb-dde70fcd5f50 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:05.530038 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:05.530692 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:05.530984 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:05.531269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:05.533165 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:05.544447 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:05.545890 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:05.554525 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1450/2921] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:05.937180 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:05.938646 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:05.950384 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c8a-777a-4df6-82c7-f023269d09af service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:05.954132 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:05.954778 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:05.955076 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:05.955338 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:05.957111 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:06.035034 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:06.037068 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:06.051079 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1472/2922] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:07.244183 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:07.252937 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387cdf4-a7f0-42c8-8825-e7b238a84c10 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:07.256623 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:07.257269 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:07.257561 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:07.257842 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:07.259654 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:07.273398 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:07.275075 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:07.287256 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1451/2923] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:09.877719 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:09.887449 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c3f6b-e99d-4910-98d5-1c4da57c5a63 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:09.891092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '509c7e7fcc7c4ef19c86f1ce27232d59', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:09.891767 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:09.892052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:09.892331 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:09.894116 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:09.934109 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:09.957973 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:09.959480 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:09.969636 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1473/2924] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:13.404764 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:13.406342 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:13.489271 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991264f4-4e57-49c2-abc3-e4c994042029 service neutron] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:13.494840 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:13.495880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] REQUEST_METHOD: `GET` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:13.495880 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:13.496118 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:13.497867 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:13.509849 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:13.511710 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:13.525799 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1452/2925] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:25:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:25:17.158713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:17.158713 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:17.171774 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6866df-48f1-4967-ba5e-740560dd10dd service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:17.176457 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:17.177894 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:17.178176 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:17.178454 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] PATH_INFO: `/v3/users/1f230ff343724c07a2c5248106491846` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:17.179668 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f230ff343724c07a2c5248106491846)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:17.181641 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:17.410370 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f230ff343724c07a2c5248106491846'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.411052 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f230ff343724c07a2c5248106491846'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.412278 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f230ff343724c07a2c5248106491846'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.419332 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f230ff343724c07a2c5248106491846'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.431575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f230ff343724c07a2c5248106491846'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.486327 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1474/2926] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:25:17 2022] DELETE /identity/v3/users/1f230ff343724c07a2c5248106491846 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:25:17.722217 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:17.734823 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d952a63-2cb5-4169-80e8-346f43c6f041 service placement] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:17.793704 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:17.794574 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:17.794863 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:17.795144 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] PATH_INFO: `/v3/projects/6eac8597927c4b33ac02c113b33eb9da` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:17.796362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eac8597927c4b33ac02c113b33eb9da)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:17.798262 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:17.897225 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eac8597927c4b33ac02c113b33eb9da', 'request_id': 'req-39392f44-0b64-44a7-b771-cff3b19fce97'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.902733 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eac8597927c4b33ac02c113b33eb9da', 'request_id': 'req-39392f44-0b64-44a7-b771-cff3b19fce97'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.960412 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eac8597927c4b33ac02c113b33eb9da', 'request_id': 'req-39392f44-0b64-44a7-b771-cff3b19fce97'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.961583 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:17.972614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] The token cache is being invalidate because project 6eac8597927c4b33ac02c113b33eb9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:25:17.972614 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.972980 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:17.974341 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1453/2927] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:25:17 2022] DELETE /identity/v3/projects/6eac8597927c4b33ac02c113b33eb9da => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:25:17.978589 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:17.980015 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:17.993663 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac17e-81ac-4084-b83c-6b38f3faee45 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:18.052038 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:18.052926 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:18.053752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:18.054366 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] PATH_INFO: `/v3/users/afe697f2b9e546a2a247836714af0837` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:18.055301 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe697f2b9e546a2a247836714af0837)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:18.057246 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:18.202575 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe697f2b9e546a2a247836714af0837'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.203270 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe697f2b9e546a2a247836714af0837'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.203843 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe697f2b9e546a2a247836714af0837'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.205036 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:18.211092 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe697f2b9e546a2a247836714af0837'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.222532 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe697f2b9e546a2a247836714af0837'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.280299 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1475/2928] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jul 25 06:25:17 2022] DELETE /identity/v3/users/afe697f2b9e546a2a247836714af0837 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:25:18.499040 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Authenticating user token {{(pid=80338) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:25:18.500498 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.fernet_utils [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80338) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:25:18.515362 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39392f44-0b64-44a7-b771-cff3b19fce97 admin admin] Validating token access rules against request {{(pid=80338) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:25:18.573479 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '606c52ef106342ea90cee3defca6b7ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1ff9f2a23bd646d2af236b8a1efad9a1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80338) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:25:18.574279 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:25:18.574572 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:25:18.574854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] PATH_INFO: `/v3/projects/772eb6e27c4c4131b1746340f011ed64` {{(pid=80338) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:25:18.576070 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772eb6e27c4c4131b1746340f011ed64)` {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:25:18.578331 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] RBAC: Authorization granted {{(pid=80338) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:25:18.663718 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772eb6e27c4c4131b1746340f011ed64', 'request_id': 'req-a04d775c-8742-4fe3-bed9-2bb4c14d8594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.669147 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772eb6e27c4c4131b1746340f011ed64', 'request_id': 'req-a04d775c-8742-4fe3-bed9-2bb4c14d8594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.726383 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772eb6e27c4c4131b1746340f011ed64', 'request_id': 'req-a04d775c-8742-4fe3-bed9-2bb4c14d8594'} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.737564 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] The token cache is being invalidate because project 772eb6e27c4c4131b1746340f011ed64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80338) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 06:25:18.737854 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.738476 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG keystone.notifications [None req-a04d775c-8742-4fe3-bed9-2bb4c14d8594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80338) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 06:25:18.740067 dv-cinder-848418-2-smb devstack@keystone.service[80338]: [pid: 80338|app: 0|req: 1454/2929] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jul 25 06:25:18 2022] DELETE /identity/v3/projects/772eb6e27c4c4131b1746340f011ed64 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 06:25:28.321057 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:25:28.734426 dv-cinder-848418-2-smb devstack@keystone.service[80338]: DEBUG dbcounter [-] [80338] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80338) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 06:28:39.784020 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 06:28:39.785432 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:28:39.924416 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a1fdcc-6865-432e-ac5c-cb9c9f6d01ea admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 06:28:39.982752 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df158bb2f58b492d825a7b77ff35d9da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9336b33c78dd4132bfea7ecd02e3bfab', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 06:28:39.983407 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 06:28:39.983724 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 06:28:39.984007 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 06:28:39.985766 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 06:28:39.997577 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 06:28:39.999146 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214db48e-7019-48c5-9b3a-3e114df383eb service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 06:28:40.009667 dv-cinder-848418-2-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1476/2930] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jul 25 06:28:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 06:28:50.004785 dv-cinder-848418-2-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}